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Motior, for Preliminary Injunction filed 
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‘IN THE 


UNITED STATES DISTRICT COURT 
FOR THE 
SOUTHERN DISTRICT OF NEW YORK 


ed 


BOSTON M. CHANCE 


and LOUIS C. MERCADO, individually g 
on behalf of all others similarly 
situated, 4 

Vv. 3 
THE BOARD OF EXAMINERS AND THE $ 
BOARD OF EDUCATION OF THE CITY OF 
NEW YORK: 3 CIVIL ACTION 
GERTRUDS E. UNSER, individually and 
in her capacity as Chairman of the 3 No. 
Board of Examiners; 
JAY E, GREENE, MURRAY ROCKAWITZ and r7acived /y 
PAUL DENN, individually and in their / 
capacities as members of the Board 3 


of Examiners; 
MURRY BERGTRAUM, individually and in 3 
his capacity as President of the 

Board of Education; $ 
TSAIAH E, ROBINSON, JR., individually 
and in his capacity as Vice-Presider*  : 
or the Board of Education; 

MARY E. MEADE, SEYMOUR P. LACHMAN, and : 
JOSEPH MONSERRAT, individually and in 
their capacities as members of the Board: 
of Education; | 
HARVEY B, SCRIBNER, individually and in : 
his capacity as Chancellor of the City 
School District of the City of Now York;: 
and THEODORE H. LANG, individually and 
in his capacity as Deputy Superintendent: 
of Schools of the City of New York. 


— ee Ewe we tll rl ltl lll lle 


MOTION FOR PRELIMINARY INJUNCTION 
Plaintiffs move the court for a preliminary injunction 


enjoining the defendants, Board of Examiners of the City of 


New York; Gertrude E. Unser, Chairman; Jay E. Greene, Murray 


8a 
Rockawitz and Paul Denn; and the Board of Education of the City 
of New york, Murry Bergtraum, President; Isaiah E. Robinson, Jr., 
Vice-President; Seymour F. Lachman, Mary E. Meade and Joseph 
Monserrat, Harvey B. Scribner, Chancellor and Theodore H. Lang, 
Deputy Superintendent, their agents, servants, employees, 
successors, and all other persons in concert and participation 
with them, pending the final hearing and determination of this 
action, from: 

(a) administering or otherwise making use of any written 
and/or oral test, for New York City license of 
elementary school principal or for any other 
New York City public school system supervisory 
license, which has not been prepared and validated 
in accordance with the latest standards of pro- 
fessional psychological testing as accurately 
measuring the merit and fitness of candidates 
to perform the tasks of the position for which 
the testing is being administered; and from 

(b) administering or otherwise making use of any 
examination for principal which has not been 
prepared in accordance with, which does now strictly 
adhere to, and which in no way exceeds specific 
academic and professional standards for the license 
of principal established by the Board of Education 
pursuant to §2573(10) of the New York Education Law. 


on the grounds that: 


(1) unless restrained by this Court 


defendants will perform the acts referred 


to; 


(2) such action by the defendants will result 


in irreparable injury, loss and damage to 


the plaintiffs, as more particularly appears 


in the complaint, annexed affidavits, memno- 
| randur,'in support of preliminary injunction 


and exhibits attached thereto; 


herein will not cause undue inconvenience 


iOf Counsel 


GEORGE COOPER 
435 West 116th Street 
New York, New York 10027 


ELIZABETH B. DUBOIS 
STEPHEN G. YOUNG 

| 10 Columbus Circle 
i 

j 

{ 


Now York, New York 10019 
| 
| 


| 


(3) the issuance of a preliminary injunction 


or loss to defendants but +11 prevent 


irreparable injury to plaintiffs. 


JAC 

JONATHAN SHAPIRO 
10 Columbus Circle 
New York, N.Y. 10019 
Phone (212) 586-8397 


Attorneys for Plaintiffs 
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AFFIDAVITS IN SUPPORT OF MOTION 
SUBMITTED ON SEPTEMBER 24, 1970 
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Affidavit of John R. Nailor verified on 
September 22, 1970 


ila 


IN ‘THO: 
| UNITED STATES DISTRICT COURT 
i FOR THE 


I SOUTHERN DISTRICT OF NEW YORK 


i BOSTON M. CHANCE and 


| LOUIS C. MERCADO, et al., ; 

1 : CIVIL ACTION 

I Plaintiffs,  : No. 

| Civ, 

| Ve ¢ 

| BOARD OF EXAMINERS, et al., : 

i 

} Defendants, : 

\! — ed a a ee 7 7 te 

1 

i AFFIDAVIT IN SUPPORT OF 

| MOTION FOR PRELIMINARY INJUNCTION 

| 

|| STATE OF NEW YORK ) 

} his 

|| COUNTY OF NEW YORK) 

I 

| 

| JOHN R. NAILOR, being duly sworn, deposes and says: 

| 1. My name is John R. Nailor and I am the Acting F.incipal 
- 

|| of P.S. 68 in Manhattan. 
i 2. I have worked in the New York City elementary schoois | 
! { 
| fox 23 years and I hold the New york City licenses cf Teacher 
| } 
+t 

|| of Common Branches and Assistant to Elementary School Principal. 

\| 


3. Based on my experience with the Board of Examiners’ 

| 

| tests it is my opiniun that the examinations require more skiil 
in the techniques of taking examinations than they require in 


{ 
| : 
lena knowledge or job skill. Since blacks and Puerto 


! « re ’ * * 
‘canis nears techniques -~ as opposed to securing the necessary 


—s 
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skills for doing the job -~ the system is thus discriminatory 


against black and Puerto Rican personnel. Generally, up until 
the very recent past it has been extremely difficult or impossible 
for blacks and Puerto Ricans tu participate in the special private 
coaching courses which have been used to prepare candidates for 
the examinations. Among the reasons fer this difficulty are the 
high cost of such courses and the distant lucations in which they 
were frequently held. This situation has cesuited in the 

' cumulative lack of test taking know~how on the part of blacks and , 
Puerto Ricans. If Board of Examiness' tests truly measured 

or predicted job competency, then periaps them could be some 

| justification for perpetuating these tests in their present 

| €orm. However, since I feel that these testis do not perform any 
such function, their continued use can have no effect other than 

| to perpetuate the ine ities of the past. 

4. The examinations themselves laying great stress as 
they do on a written essay portion require the skill of speedy 
writing. Skillful speed writing, I submit, haa no relevance 
‘to success on the job. 

5. The examination system further magnifies the effects © 
of deprivations of blacks and Puerto Ricans in that there are 
very ‘ew blacks and Puerto Rican menbers of the supervisory : 
hierarchy which drafts the questione and grades the answers. 

Since it is undeniable that the experiences of blacks and 
Puerto Ricans are frequently different from those of widdle 
class whites, the senuken of the system in terms of nagnityiag 
cultural differences to the detriment of mincrity persons are 


Obvi ous. 
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3 
6. Further ovidence of the invalidity of Board of BKeniners | 


tests is supplied by the fact that no attempt is made to 
individualize qualifications for licenses te meet the needs of | 
Specific school populations. The tests are given on a citywide 
basis so that the very same criteria are used to license both 
persons who will serve the predominantly white middle class school 
| ana predominantly non-white ghetto schools. Leadership experience 
and community rapport are granted negligible weight in the grading. 
| of examinations. | 


7. To my knowledge there has never been an correlation 
| between success or lack of success on Board of Examiners’ teste 


and the ability of individuals to do the job being tested for. 


Signed and sworn before me 


Notary Public 


ANNE ABRAMS 
NOTARY PUBLIC, STATE OF NEW YORK 
No. 31-000E635 
Qualified in Now York County 
Commission Expires March 30, 19) | 


_ Affidavit of Alfredo Mathew, Jr. verified on 
September 22, 1970 
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IN THE 


| - UNITED STATES DISTRICT COURT 


ee ee 
a ei 


tl 
| FOR T°" 
| SOUTHIRN DISTRICT OF NEW YORK 
| 7 | 
Gee | 
3 
3 BOSTON M. CHANCE and , 
i} LOUIS C. MERCADO, et al., : -4 
CIVIL ACTION 
' Plaintiffs, :; No. 
Civ. 
Vv. : 
BOARD OF EXAMINERS, et al., 2 


Defendants. ;: 


MOTION FOR PRELIMINARY INJUNCTION 


STATE OF NEW YORK) 
) SS.: 


\ 

{ 

| 

{ 

| 

\ 

| 

| 

| 

| : 
| AFFIDAVIT IN SUPPORT OF 
| COUNTY OF BRONX ) 


ALFREDO MATHEW, JR. being duly sworn, deposes and says: 
} 1. My name is Alfredo Mathew, Jr. and I reside at 50 


| Orange Street, Brooklyn, New York 11201. I am the regularly 
| appointed principal. of Junior High School 98, 1619 Boston Road, 


a 


2. -I graduated with a B.A. degree cum laude from 


City College of New York in 1955. I earned a M.A. from City 


EE LE EN 
—~ 


| Bronx, New York 10460. 
| 
| Coliege of New York in 1961 and I am presently a Ph.D. candidate 


3. I have been continuously employed in the New York 


4 

| 

| 

| City school system since 1954. I hold the following New York 
| City liernses: Regular Teacher of Social Studies, Junior High 


in Educational Sociology at New York University. | 
} School; Regular Teacher of Social Studies, Senior High School; | 
| 

| 


f Assistant Principal, Elementary School; Assistant Principal, 


5 ae 


os 


: Léa 
: Junior High School; Social Studies Chairman, Junior High School; 
] e and Principal of Junior High School. I also hold New York state 
| 


certification as Principal and as District Superintendent. 


defendant Board of Examiners in which position = helped to 


{ 

| 
4. I served briefly in 1969 as an assistant examiner for | 
administer the examination for, assistant principal of junior 
was working at = Board ‘of Education as a supervisor of bilingual ; 
teachers, I was horrified to leam that the personnel at the Board 
of Examiners who prepared the examination for this position were t 
almost totally deficient in either a knowledge of the job of 
bilingual teacher or of the Spanish language and the Pucrto 


: high school. Just prior to my serving in that position, when x 
Rican-Hispanic culture. My distaste for the crudeness anda 


unimaginativeness of the examination system was confirmed by my 
|| Subsequent experience as an assistant examiner. I was shocked 


W by the pat answers which were prepared by the Board of Examiners ' 


myself in evaluating the c=ndidates. 


| chosen experts as guides for the assistant examiners such as 
| } 
| 5. It is my opinion that the examination techniques place 


pressure on the assistant examiners to pass candidates who have 


mastered the mnemonical approach to supervision. Not only is it 


| 
| 
| 
| 


a oo ee 


my feeling, based on my experience, that the Board of Examiners’ 
| system does not produce tests which measure the capacity of the 
| candidates to do the job being tested for; but x further believe 

that this system and the kind of “successful candidate it 
produces is in large measure responsible for the failures of our 
De | school system. 


6. % would further emphasize the fact that questions and 


meme nes eee 
A RO A GALE, CSR een nt ee 
ee 


| iterviews of Board of Examiners’ tests are composed by the very 


Vs 
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supervisors whose failures have in large measure precipitated 
our current educational crisis. Thus, the Board of Examiners’ 
system is specifically geared to "inbreeding" and therefore, to 

| perpetuating the inadequacy of the system. There is no question 
in my mind that the Board of Examiners' procedures do not measure 
merit and fitness, but rather that they sustain expediency 7*nd | 
cynicism. 


Signed and sworn before. me 


this s20 ty of Sef - 1970. 


ROGELIO PABLO 
Notary Public, Stete of New You 
No, 03.8731367 


: 
FE 
ig 
i 
; 
| 
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[N THE 
UNLTED STATES DISTRICT COURT 
. FUR ‘THE 


SOUTHERN DISTRICT OF NEW YORK 


BOSTON M. CHANCE and 


LOUIS C. WERCADG, «c 4i., | : 
Pinintifts, : CIVIL ACTION & 
No, 
Vv. ; +g Civ. 
BOARD OF EXAMLNERS, et al., : 
Defendants. 2: 
\ 


AFFIDAVIT UN SUPPORT OF 
MOTION FOR PRELIMINARY INJUNCTIN 


STATE OF NEW YORX 


) 
) SS.: 
COUNTY OF NEW YORK ) 


PETER J. STRAUSS, being duly sworn, de, 25 ard says: 


1, 2 aya an attorney. . law and partner in the firm of 


Molidover Hauser and Strauss with offices at 110 East 42n¢ Street, | 


New York, New Yor. I am presently Chairman Pro-Tem of Comnu- 


nit. School Loard #2 in the Borough of Manhattan, \ Formerly Z 


most of the East Side of ifanhattan. The Coomunity Board took 
office, and the Local Board ceased to exist, on July 1, 1970 
pursuant to Article 52-A of the New York Education Law which 


estanlished the, New Yor’ City Canununtity School Districe Systan. 


i 
was a member of Local School Board #2, whose jurisdiction covered | 


| nN 
‘ 
' 


| 
| 


asses ae © 
So ae ee ee ee ee 


een eS ET 


_ will concern itself with certain of my experiences on that board. 


Education Law permitted us to consider all persons on the appro- 
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I am submitting gois affislavit on my own behalf and not in my 


official cdpacity. 


\2. 4 served on the old Local Board for approximately 


tw? years, up to the time it ceased to exist. This affidavit. 


3. Unc of my official duties as a member of the Local . 
: : . 1 
Board was to select supervisory personnel, such as Principals and ! 
Assistant Principals, for schools in the District. During the 
i 


' 
we selected from competitive lists of licensed persons under Pro- | 


a 


cedures which enabled us to choose among only the top three | 


persons on the appropriate List. Subsequent modification of the 
. eee 


priate list, which usually included more than one hundred persons.’ 


In addition, we considered numerous persons not on a licensed 


‘list for positions, when applicants from licensed lists did not 
fe 


meet our standards. 

%. ti, on the other duly appointed members of Local 
Board #2, placed sreat emphasis on buman qualities! in selecting 
a principal. We of course believed that education qualificationg 
of a high order and experience in schools are crucial, But 
beyond this, a principal must be cognizant of the special pro- 
blems of the comnunity in which his school is located, must be 
sensitive to the best means of handling those problems, and must 
is aka Gs Asad eflaccively vith ce children, teachers and 
parents at tha school. He should be concerned with the training 


o£ his teachins, staff and should in all respects consider him- 


€ 


™ 4 : ¥ 
aa) 


‘ 


2la 


self the educational leader of his school -* not merely its 


ehlef administrator. 


5. Subsequenc to che statutory modification permitting. 


us wider latitude in personnel selection, there arose several 
Openings for principals in our district. My general impression, 
based on interviewing a range -£ licensed and unlicensed persons, / 
is that the possession of a license is nct necessarily proof of 

a person's queliticacions fer the job.: With respect to all but 
two of these vacancies, we were able to find licensed candidates 
who also possessed the hunan qualifications which are so impor- 
tant, and we were pleased to appoint licensed principals to fill 
these vacancies. In the other two cases, however, the licensed 
applicants did not possess the necessary qualifications for the 
particular school involved. : 

6. The deficiencies of the licensed applicants for 
these two positions of course varied from person to person. In 
General, however, we found them to lack comprehension of local 
problems or their pessible solutions. Moreover, the licensed 
applicants were unduly inflexible in their approach to educa- 
tional problems. ‘They tended to give stock answers to complex 
problems rather than offer imaginative solutions to meet the 
particular situation at haad. 

7, The two schools for which oe were unable to make 
&n appointment from among the licensed applicants were P.S. 168 


and P.S. 59. In each case we adveztised the opening for many 


ee ee me eee ES oe ee ame ene o. 


wonths and willingly interviewed all person's on the licensed 


a =< 


list who made anplications. 


: designed to improve the educst tonal experience in disadvantaged 


: leadership for that schoo]. We interviewed seven license appli- 
* i 


, cants, none of whom had experience in MES schools and none of 


22a 
(a) In the case of P.S. 168 located at 316 East 


105th Street, the openiny had existed for about two years. . 


¥.S. 168 is part of the Mts (More Effective Schools) progran 


areas and we are particularly concerned with obtaining the best 
‘ 1 « . 


ee a NE AE eee 


whom, in our opinion, met’ the needs o£ tha school in other res- 


pects. On the basis of outside recommendation we also solicited 


Ee oes em eee - 


the application of an assistant principal at a nearby MES school 
who is not licensed as a principal. This individual was senans 
viewed, as were the licensed applicants, by a committee consistin 
of Local Board members, and parents and teachers of P.S. 168. 

The general consensus of the committee nembers was that of all> 
candidates considered, this individual's background and experienc 
and his understanding of the siniheis of the school, rendered 


him more qualified than the other candidates interviewed. At 


ee Be i 


that point Local Board #2 considered offering the position to 
him but no formal action was taken because of pending Litigation 
affecting our right to make such an appointment at that time, 
The term of the Local board then expired, leaving the position 


vacant. The school is not under the jurisdiction of Community 


: (b) In che case of P.S. 59 located at 228 East 57th 


| 
Board #2. : | 
Street, the opening had existed for about three years, This 

i 


: school is not in a disadvancaged area and attracted more appli- 


‘ cants. We interviewed twelve Licensed persons, none of whom 


q 
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were satisfactory. ‘ihe vresent acting principal, who is not 
licensed as a princinal, ‘was considered by che Local Board and 
evens of P.S. 59 to be more qualified than any of the licensed 
candidates to be head of that school. During this three-year 


tenure as actin, principal, he has performed in a superior 


‘ manmer. P.S. S59 is within the jufisdiction of Comminity Board 


- #2, which has retained this individual as acting principal. 


? 


8. On the basis of my experience as a school board 
member, it is my considered judgment that the holding of a 
license granted under the existing procedures is not a true 


test of the qualifications of supervisory personnel and prevents 


Community School Boards from selecting the most qualified persons ; 


for particular positions. / 7 


Fae 
ETER .. 


Signed and sworn before me 
op 


this << of “Seth s , aa70 


———— 
ee 


Notary Public 


EDWARD 0. MOLOCVER 
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Affidavit .; Edwin J. Haas verified on 
September 22, 1970 
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MERCADO, et al., 
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IN THE 


UNITED STATES DISTRICT COURT 
FOR THE 


SOUTHERN DISTRICT OF NEW YORK 


CHANCE and 


’ CIVIL ACTION 
Plaintiffs, 3 No. 


19Civ. 
' 4H) y-; 


Ve 


| BOARD OF EXAMINERS, et al., : 


Defendants. t 


ot 


AFFIDAVIT IN SUPPORT OF 
MOTION FOR PRELIMINARY INJUNCTION 


STATE OF NEW YORK ) 


) SS.: 


COUNTY OF NEW YORK) 


DR. 
oe 


in Manhattan. Previously, from November 1, 1968 to July 1, 1970, 


I was District Superintendent of the Former District 6 Local Schoo 


Board, 


2. As Superintendent, my responsibilities have included 
advising Local School Board #6 regarding the selection and 
appointment of supervisory personnel for all schools and programs 


within said district. 


Je 


!} and 5 middle schools (one I.S. and 4 junior high). The student 


population in the public schools in District #6 is approximately 


EDWIN J. HAAS, being duly sworn, deposes and says: 


I am Acting Community Superintendent of District 46 


District #6 had jurisdiction over 20 elementary schools 


A i cee ns ere ea es see 
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iH : ' +| 
i i 
| 59% black, 31% Spanish-speaking and 10% white. 

4. District #6 had approximately 8 vacancies for the 
position of pr’ ‘meipal of an elementary or junior high school over : 


the past twe years. 


S. z worked with the Local School Board and the ae 


ns 


eieieataies of the schools involved to find the best available 


candidates for those positions. We had in each case follcwed 


a eamnemna ae 


the established procedures in first soliciting applications from 
persons on the appropriate supervisory lists. However, in most 


cases we were unable to find applicants from said lists who were 


‘ qualified for the particular principalship positions in question. 


| 


| Instead, in order to obtain the persons most qualified for said 


| --sitico.s we were forced to select persons not on the prescribed | 
_ts and appoint them as acting principals. Thus for example, | 
we had a vacancy for the position of principal at P.S. 192. We 
first considered the three persons who applied from the | 
principal's “ist and selected one who later declined our offer. 
We subsey.cntly searched for the best person available for this 
position. Mr. Alejandro Rodriquez appeared to the Parents 
Association of P.S. 192 and to the Local School Board to be the 


best available candidate. He has a State Certificate as Principal 


{ 
he was an intern in the Fordham University oven Program | 
for Urban School Principals and Administrators; he has been an 
acting assistant principal for 15 years; he had administered a 
cluster cf schoois in a heavily Negro and Spanish-speaking 

section of District #6 for a number of months; he is of Puerto | 


Rican descent. We feel he is uniquely qualified to serve 4s 


eee = 


| principal of P.S. 192. However, he does not have a New York 


City principal's license. The fact that he does not have such ! 


L 


cd 
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| ‘ 
| a license is, in our opinion, Of no celevante to his capacity to 


perform as principal of P.S. 192. Therefor- ve appointed him as 
acting principal of P.S. 192 on April 30, . : 
\ 


| 
| 


6. Zt has been our experience that there axe. patsons on 
the supervisory ats with excellent qualifications. But it has 
also been our experience that persons not on such lists often 
have equally good quali fications and in many instances appesr to 
| be the most yj. 1lified candidates for particular positions. In 


sum, we have found that, in looking for people to fill particular 


| 
| 


list is of no particular relevance to his capacity 


supervisory positions, the fact a candidate appears on a ee 


to perform the position he is thereby legally eligible for. 
7. %In my opinion, the reasons that the supervisory lists do | 
i.ot provide in many cases candidates qualified for the supervisory 
positions we have had to fill include the following: 
| (a) The specific abilities and qualifications requixed 
for particular positions depend in large part on 
: characteristics of the particular school erea and 
| district. The examinations conducted by the Board 
of Examiners take no account of the varied needs of 
! Gieterent kinds of schools and localivies. A list 
| : | consisting of a highly limited number of perple who 
| have passed such “an examination in meay cases simply 
| contains no candiuates with the particular qualifi-~- 


eations required for a particular position. 

The listscontain virtually no black and Spanish- 

| speaking persons although in my opinion some such 
| persons are needed in leadership positions in 

' district such as ours, and there is no reason to 
believe that k*: and Spanish-speaking persons as 


a group do not have the necessa: qualifications to. 


*) 
“all 
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serve as supervisors in the New York School System. 


(c) In my’ opinion and from my experience the supervisory 
examinations conducted in the past test for certain 
abilities a-4 capacities which appear wholly unrelated 

to the qualities necessary in a good supervisor. 
Moreover, the examinations are in many respects 
culturally biased in that they test for abilities 

_and capacities which -- although unrelated to the 
capacity to perform as a supervisor -- are far more 
likely to be possessed by persons from white, a 
middle-class backgrounds than by black and Spanish= 
speaking persons. Thus, for example, the examinations 
typically contain substantial sections which test 
familiarity with a certain kind of cultural background 

. Which blacks and Spanish-speaking persons have not for 
‘the most par. had. In my opinion, success on such 

‘.questions has no relevance to a person's leadership 
capacity. Since no comparable questions are asked 
relatiny to black and Spanish-speaking people‘s 
background, the tests have a built-in bias. 

(a). Numerous aspects of the procedure by which the : 
supervisory examinations are given have tended to 
lock out black and Spanish-speaking persons from 
takiug and passing said examinations. For examples 
‘1) The substantial coaching course fee ($500-$600) 
charged in the past,* coupled with a feeling that 
they will not be given a duty chance, discourages 


applications; (2) Black and Spanish-speaking 


. 
* Now the Board of Education aives such courses. free of charge. 
- Thie is an improvement. e 3 


- gs : ¥ 
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persons are virtually unrepresented among the 
assistant examiners who conduct the examinations 
ie . and administer the subjective oral interview 
‘ and observation aspects. This latter is of particular 
_ importance since these are almost the only aspects 
of the examinations which purport to test for . 
leadership qualities. ! 

8. In my opinion it would be possible to design examinations 
which would in fact test for qualities relevant to jcb perforn..ice 
However, in the absence of such examinations, I believe that 
Community School Boards would be best enabled to select the most 
qualified persons for available supervisory positions if they were 
free to appoint any person who possessed the requisite State 


certification for the. position in question. 


Chr é we 
Edwin J. Haas 


1 


Signed and sworn before me 


this }» day of — 1970 


MERGERY HOLLAND 
Wetary Pub’. 
wo &! 1935835 : 
Va iy Pachtand ene 
Someniag.on eosirme carck 30, 12807 7/ 


Affidavit of Edythe J. Gaines verified on 
September 23, 1970 
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IN THE 


UNITED STATES DISTRICT COURT 
FOR THE 


SOUTEERN DISTRICT OF NEW 


SOSTON M. CHANCE and 
LOUIS C. MERCADO, et al., 
CIVIL ACTION 
Plaintiffs, 5 No. 


Civ. 
Vie 


BOARD OF EXAMINERS, et al., 


Defendants. 


A. FIDAVIT IN SUPPORT OF 
MOTION FOR PRELIMINAPY INJUNCTION 


STATE OF NEW YORK) 
) SS.3 
COUNTY OF BRONX ) ‘ 
EDYTHE J. GAINES, being duly sworn deposes and says: 
1. My name~is Edythe J. Gaines and I am Community 
|; Superintendent for School District 12 of the New York City Public 
| School system. My office is located at 708 East Tremont Avenue, 
| Bronx, New York. 
2. I have been an employee of the Board of Education of 
| the City of New York for twenty-five years, beginning in September | 
| 1945. During that period I have served as a classroom teacher 
for seven years (1945-1952), a core curriculum coordinator for the 
; Junior High School division for three years (1952-1955), an 
assistant principal for five years (1955-1966), a junior high 


school principal for seven years (1960-1967), a district 


Pad 


I 


| 


| 
| 


. 


' 


| 
| 
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Superintendent for three years (1967-1970), and have just been 
elected to a four-year term as a Community Superintendent 


(July, 1970). 


3. With the exception of the superintendentship I have 
acceded to each position as a result of passing examinations 
administered by the Board of Examiners. Also, both as assistant 
principal and as principal I served as ce assistant examiner for 
the Board of Examiners. I participated in administering oral 
interview examinations and field tests for teachers. Thus, I 
have experienced being subject to those examinations procedures 
as well as directly participating in carrying out such procedures. 

4. I believe that the testing procedures of the Board of 
Examiners are such that blacks and Puerto Ricans feel discouraged 
from even applying to take such tests. ‘shat Z offer is 
speculation based on long experience. People just do not flock 
to what they perceive to be a closed system. The feeling is that 
only the more courageous among minority group persons can 
"break in.“ This, feeling becomes a powerful deterrent to the 
professional who perceives himself as competent but not as 
na giant." A related factor is that traditionally few blacks and 
Puerto Ricans have had the experience requirements to take 
supervisory examinations. For example, five years of experience 
under the regular teaching license used to be required. Such a 
license could only be securcd by passing a Board of Examiners test 
For this reason too many blacks and Puerto Ricans served long 
years under substitute licenses and therefore do not have the 
required five years under the regular Lion: Again the 
perceptual problem had an effect. Such persons felt that the 
regular examination would be too difficult, that through direct 


4, 
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| means or indirect ones hey would ultimately be failed, that they 
would be permitted to pass the substitute so but would 
not be permitted to pass the regular one. 

5- Much of the fear among blacks and Puerto Ricans : 
centered on those Board of Exjiners' tests in which the 
candidate could not be anonymous - that is, the oral interview, 
the field or practical test and the physical examination. oo’ 
feit that if they could get. through the written parts of the 
examination they would be "knocked down" on one or more of the 
other parts. Especial concern existed about the speech 
examination which at one time was a spearate examination and 


*« 


Which continues as part of the oral interview. Regionalisms 


in any way "Negro" were the cause of countless failures. The 
first black principal of a New York City public school 

(Mrs. Ayres) relates how she was failed on her first ae on the 
basis that she had “southernisms" in her speech although she was 
born, raised and edycated totally in New York City. Stories of 
this kind abound among black and Puerto Ricans. 

6. To my knowledge there is no evidence at all to prove 
or even to suggest that supervisory examination do indeed select 
candidates who have skills and abilities needed for ne im. 
There is no evidence to show that candidates who were failed were 
unable to do the job. Indeed there is much informal evidence to 
show that there is zero correlation between the examination and 
capability at the job. Here, I have reference to the fact that 
people in “acting” capacities have taken the examination. 


Other professionals can cite examples of people who have served 


! 
| 
| 
in speech, especially “southernisms," that is, speech that sounds 


~_ 
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with distinction in an acting capacity but failed the examination 


not once but severa’ times. Other professionals can cite 
examples of candidates who come out "at the top of the list" but 
who are virtual incompetents on the job. The standing game among 


examination takers is to list ‘test items that are most 


| 
: 
| 
| 
| irrelevant to the jol. I remember that at the examination I took 
| for the principalship of a junior high school, r was asked to 
identify various types of saws used in woodwork and to show that | 
| I knew what a notch was in sewing. : | 
7. To my knowledge there has been no validation of Board 
of Examiners tests at all. The best that can be said for the 
examination is that they are composed by members of the profession 
I| whe serve in tne capacity for which the candidate is to be 
| examined. That lends at least the possibility of some functional 
validity to the examination. However, no test expert would 


‘. suggest that that was enough to validate a test. 


Signed and sworn before me 


this 33% day of Sap. , 1970. 


Notary// Public 


MARJORIE 4. DOGWELE 

WOTARY PUCLIC. Siat> 0° New York | 
Ne. 03-6°.3 499 

| Qualified tp Seok Cocety 

Commission Eapires March 32, i972 
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Affidavit in Support of Motion of Richard S. Barrett 
verified on October 15, 1970 and submitted on 
October 20, 1970 


» IIe 
IN THE 
UNITED STATES DISTRICT COURT 
. FOR THE : 


SOUTHERN DISTRICT OF NEW YORK 


BOSTON M. CHANCE and. a4 
LOUIS C. MERCADO, et al.,' og 


Plaintiffs, : CIVIL ACTION 
vy. 3 Ne. es é 


~} ==! 
BOARD OF EXAMINERS, et al., : 70 civ. 4f41 
ce {en} eh Pad 


. ' Cc aon ‘ 
Defendants. : cE ‘eae 


MOTION FOR PRELIM: °°. INJUNCTION & 


| 
{ 
i 
: ! 
AFFIDAVIT IN SUPPORT OF 7° 7) bie. | 
STATE OF NEW YORK ) | 
+) 66. 
COUNTY OF NEW YORK) | 
DR. RICHARD S. BARRETT, being first duly sworn, deposes and | 
gays: 
\ 
i. I live at Five Riverview Placo, Hastings-on-Hudson, ~~ 
York. JZ am Research Director of the School Division of the Center 
fox Uxban Education, 105 Madison Avenue, New York City.” I 
received a B.S. in Aduinistrative Engineering fxom Cornel). in : 
_1948, an M.A. (Ed) fron Syracuse in 1952, and a Ph.D. in Industrial! 
Psychology from Western Reserve University (now Case-Western 
Reserve). 


2. I was principal investigator of a study sponsored hy 
the Ford’ Foundation Which resulted in the book: Kirkpatrick, ToTol 


TE on ES THR Ga RES 


o ‘ .* ‘ oF : 
| * he views expressed jn thin affidavit are im own and do not. 
necessarily xepresent the position of the Cortur for Urhbun Eduewtie: 


| 


Ewen, R.B.; Barrett, R.S.; and Katzell., R.A,, Testing and Fair 
Employment, New York University Press, 1968; 1 have consulted 
on employment testing ‘with, among others, United States Air Force, 
Standard Oil (New Jerscy), Lever Brothers, and Equitable Life 


‘Insurance Society. 


3.. I have examined the previously administered examinations 
for supervisory positions in the New York City school system 
listed below snd asec oe EAE 

(4) Principal, Day Elementary School, March 30, 19s 


(7) AssPstant Principal, Junior High School, 
September 3; 1968 


44) principal, Day High School, March,Z9, 1968 


April 3 & 4, , 1961 

(5) Assistant ao ‘principal, Day High ‘Sthool 
(Administration) December 29, 1969 

(6) Assistant to Principal, Day Elementary Schools, 


| 
t 
| 
(4) Principal, Day Elementary. School (men _ women) , S 
April 22° & 22, 1965 ee | 


I have given particular attention to the Examination for Licen e 
as principal of a Day Elementary School, given March 30, 1964, ee 
Examination for License as Assistant Principal in Junior High 
School, given September 3, 1968. I have formed the Opinion that 
these tests are likely to discriminete unfairly against candidatos'! 
for licensed supervisory positions who come from ethnic minority 
groups, particularly Negro or Spanish-spe ving. In the absence of, 
validation data, it -is ampossi bie t> determine that the tests do 


in fact discriminate unfairly. My judgm nt can only bo pased on 


examination of he tests and other documents. The reasons for thc 


' 378 


Opinion that the tests are iikely to discriminate unfairly are 

set forth below. ae . 
4. Content analysis of the tests discloses their highly 4 

esoteric nature. For example, the test for Assistant Principal, 


Junior High School asks for the definitions Of such words as 


Eumptuary, congerios, ‘beadle, .Plethoric and rocension, Other 


questions range wide over weather, the Taft-Hartloy Act, aqua 
regia, geology, ete. Such general intelligence and in< omational 
tests are commonly tsed for .:predicting school grades, Their - 
validity for selection of supervisory personnel can be determined 
by a validation Study, but cannot be guaranteed in any othor way. 
Some of the essay questions on this examination and on the 1964 
examination for principal, day elementary s¢hool, present ° 
problems which appear to be Felated directly to school practice, 
and their inclusion might be! justified on the grounds that they 
have co: cent validity, that is, they might constitute a valid 
work sample. I¢f they have content validity, they have the kind 
of inherent validity that a good typing test has for a typing 
job. However, for a test at this level to be justified en the 


basis of content validity, it is necessary that the job be 


significant aspects of the job prepared, level of acceptability 


of answers defined, and test scorers trained and supervised, 


analysed, good and poor performance defined, questions relevant 


Statistics on the reliability of the scores given by two different 
scorers and the difficulty of the items must give siutisfactory 


results, - In the absence of these steps, a claim of content 


‘ ET 33 


validity is not ; susts fied. 
| t 
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5. It has been widely documented that ethnic minority 
groups, especially Negro and Spanish-speaking, score lower on 
average on tests i: general, including the kinds of tests 
described above, than whites whose native language is English, 
but that lower test scores do not necessarily mean poorer job 
performance. Furthe~, Spanish-speaking candidates are likely 
to be handicapped by vocabulary items, A test cut-off score 
whit, in all probability, lininate & substantially larger pro- 
portion of Negroes and Spanish-speaking candidates than whites 
whose native language is English, in the typical selection 
Situation. If it does not also eliminate a higher proportion of 
potentia) failures than is found in the accepted group, it is 
discriminating unfairly. ‘ 

6. The tests have a passing score of 60 percent (with 
Some exceptions). this Standard is arbitrary, since a score of 
60 percent can be very easy or very dirficult to attain, 
depending on the character of the items, Being arbitrary, and 
having the potential for wide veriability, the test standards 
cennot be accepted as being reasonable without an empirical 
check to determine what level of test score is required for 


acceptable perfornance. 


7. Basic to the use of all selection procedures is the need 
to fit them to the particular job for which the candidate is 
applying: otherwise int, prepriate teste or other measures may be 
applied. An informed luyman knows that the work of a principal 
ox other supervisor varies not only with the level of school, 


but also the socio-economic and ethnic make-up of the student 


body, thé size and age of the facility, the character ‘of the 


. a 


to be equally volid for job sottings that diffor o0 widely is to 
oxpect tho imposiible. 

8. It ie not unreasonable, howovor, to demand validity from 
& sciection proccduro for positions of the lev7l of supervisor 


in & major school system. Many private employers, such as the 


kf | 
Local community, and other conditions. Te expect any, BSingsoc tout 


assessment centers where valid predictions are made regarding 


success On a wide variety of executive positions. These sclection 


= Telephone ond Tolegraph Company, have established | 
| | 


| Procedures mako little use of the type of questions typical of tho: 
|| Supervisory tests I examined for purposes of this affidavit. | 
9. Section 2569 subd. 1 of the New York Education Law sehen! 
in part: 
+ + + The Board [of Examiners] shall period’ “lly 


review the validity and reliability of examin tions 
as well as examination procodures, 


Paragraph 3, supra) and the conplaint, motion for preliminary 


| injunction and supporting memorandum filed by plaintiffs in the 
irstant action, the teste administered by the Board of Examinere 


| 

| 

| | 
| xn my opinion, based on the tests I have examined (listed in 
| | 
! 

' 

. . ’ | 

have not been shown to be valid, reliubie or fair; and it is likecy 


that an empirical examination would show that they discriminate 


justification in terms of selecting the best~qualified persons 


for supervisory positious in the New York City school system. 


| 
ee SS ht oe | 


RICHARD S. BARRETT 


{ 

| 

on the basis of race or ethnic status without any rational 
Sworn to before ino this 


| ~~ day of October, 1970 
| 4 

| 

| 

| 


. WORMAN [aatitt 
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Noa. 31-2509750 
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j 2N THE UNITED STATES DISTRICT courT * .. 
4° FOR THE SOUTHERN DISTRICT OF NEW YORK 


BOSTON M. CHANCE ana 
LouIs c, MERCADO, et al., 


Plaintiffs, Civil Action No. 
. 70 Civ. 4142 
ve 
BOARD OF EXAMINERS, et al., AFFIDAVIT 


Defendants, 


ana ae ce 
etmiemenneeen = + ote eae 


STATE OF NEW YORK ) 
G2 ye > BB.3 
COUNTY OF ti THY Rx. ) 

GERTRUDE E. UNSER, being duly sworn, deposes 
and says: 

1. I am Chairman of the Board of Examiners of 
the Board of Education of the City of New York, and one 
of the defendants herein and submit this affidavit in 
opposition to plaintiffs’ motion for a preliminary 


injunction. 


Sy Each year thousands of Successful arrlicants 
meceive licenses ag teachers and supervisors in the New 
York City schools. They are needed to fill newly created 

positions, to replace teachers and Supervisors who retire 
! or G@ie in service and to replace those who resign to take 
positions @lnewnere., The licensing of teachers and super= 
f Visors 1s controlled Dy state law which, while undergoing 
numerous anendments, goes back over 70 years. 
! 3. Article VY, Section 6 of the New York State 


{ 
Constitution provides in relevant part: 


"Appointments and promotions in the 
“Civil service of the State, and all 
of the civil Subdivisions thereof , ee 


2a 


shall be made according to merit and: 
fitness to be ascertained. as'far as 
practicable, by examination’. *, ," 


In order to thsure the carrying out of the constitutional 


mandate, Section 2569 of the New York Education Law pro- 
vides for & Board of Examiners in cities having a popula- 
tion ef one million or more® which ig charged with the 
duty ; 


"to hold examinations whenever 
necessary, to examine all appli- 
Cants who are required to be 
licensed or to have their names 
Placed upon €ligible lists for 
appointment in the Schools in such 
city, except examiners, and to 
prepare all necessary eligible 
lists, subject to the responsi- 
bilities among the members of the 
board of examiners hereinafter 
set forth. The beard shali 
eriodicelly review the validity . 


it. It shail perform such other 
uties as the board of education 

‘and the chancellor of said city 

School district may require," 


“4. Article V, Section 6 was enacted in 1854 
in the Spirit of reform which followed the enactment of 


the Pendleton Act in 1883. New York was leading ..* way 


for states by pursuing the federal government's intro- 


duction of the application of civil service to public 


"Contrary to plaintiffs! allegations New York City 


is not the only city to hold examinations for licensing 
feachers and Supervisors. §2573 Subd ldec of the Educa- 
tion Law provides in part: 

"In a city having a population of four hundred 
thousand and less than one million it shall be the duty 
of the Superintendent ‘of Schools, at the direction of 
the board of education, to hold examinations whenever 
necessary, to examine all applicants who are required to 
have their names Placed upon eligible lists for appoint- 
ment in the schools of such cities and to prepare all 
mecessary eligible lists. . * 


The City of Buffalo falle within tHis provision. 


hig deputy. Four members are chosen through Open come 


petitive examination by the New York City Department of 


' 


| Personne under regulations set by the State Commissioner! 
Of Education. rt 4, Widely acknowledged that this exemi- 


: nation is Perhaps the most difficult Given anywhere for 
) @ny public Position, : 


i ina "capacity involving a high degree of responsibility 


7 and of @ Character to fit the Candidate to Carry out the 


duties of the Position." ry the most recent examination, 


Loa 
of 108 who applied from all over the United States, only 


five were successful, 

It is apparent that the Board of Examiners is 
a 8 highly select group with broad professional _ background 
in education and related fields chosen through the most 
retire and impartially searching examination given under 
civil service, 

. 6. In furtherance of the constitutional 
directive that positions be filled on the basis of "merit 
and fitness" and Subject to the provisions of the Educa- 
tion Law and the By-Laws of the Board of Education, it - 
is the duty of the Board of Exeminers to hold examinations 
for teaching, administrative, Supervisory and other 
licenses and prepare appropriate eligibility liste for 
appointment to the public schools of the City of New 
‘York. The need for examinations 1s determined by the 
chancellor and the Board of Education sets eligibility 
requirements through its By-Laws. 

1 The Board conducts examinations for over 
1,200 licenses ana certificates of competency. There 
aré approximately 4,000 supervisory positions alone in 
the school system, which positions pay approximately 
$20,000 to sea per year. The position of elementary 
school ‘principal pays approximately $25, 000, which amount 
is also paid to persons holding ths position of acting i 
principal. Plaintiffs Chance and Mercado hold such 


positions. 
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8. Comalssioner of Education Nyquist has ruled 


that persons who hold a position in an acting Capacity 


for not less than three years shall be deemed to have 
A. €¢ Citations af te} “f poge 
tneure in such position. , Clearly, if plaintirrs Mercado 


and Chance could delay the scheduling of examinations 
sufficiently, they would de in a position to claim tenure 
48 principals. 
9. The duties or the Board of Examiners as 
set forth in Section 2559 of the Education Law are detailed 
in Section 1 of the By-Laws of the Board of Examiners. 
A copy of such By-Laws is annexed hereto ana marked 
Exhibit "A". In brief outline, the activities of the 
Board of Examiners in conduc a test are as follows: 
(a) The Board of Examiners determines the 
| scope énd form of the tests to be used. The scope 
depends Upon the nature of the duties of the position as 
described by the Superintendent. It may include 
objective-type and essay-type written tests, an interview 
test, a teaching test, a conference test, an inspection 
test, a medical examination, and an €valuation of training 
; @nd experience, See Examination Regulations attached ase 
) Exhibit B. (0) In line with a cardinal principle of the 
merit system, it announces all examinations, publishes 
the qualifications and scopes, and invites all interested 
applicants to apply without restriction, 
‘(o) As another necessary. part of a merit 
system, the exaiiners insure that all applicants are 
treated with confidentiality and take all precautions 


with respect to Security such as anonymity of rating. 


: 4oa 
(4) The Board of Examiners’ selects, trains 


and supervises assistant examiners chosen from the 
teaching and supervisory staff of New York City and i. 
other cities throughout the nation as well as from 
colleges, universities and appropriate social agencies. 
The most experienced experts in the field are actively 
sought out to help plan and administer all parts of the 
examination. ‘ 
| (e) Giving the examination is not enough. 
Every candidate, under the merit system, has the right 
to procedures which are reviewable and which are amply 
documented. He has the right to know why he has been 
rejected, including the right to be provided with a set 
of reasons for failure. 

(f) Finally, the failing applicant has the 
right to take appropriate action to get relief. He may 


appeal to the examiners for rerating or reconsideration 


of any and all parts of the examination. These appeals 

_are considered by a committee of examiners who were not 
involved in any way in the conduct of the examination the 
candidate has failed. If he is still dissatisfied, the ~ | 


failing applicant may appeal to the State Commissioner 


or seek relief in the courts. 

10. The selationahip between the Board of 
Examiners and the Board of Education has been the subject 
of several determinations ‘by the beutks of this State and 
the Commissioner of Education of the State of New York. *# 


It has consistently been held that in determinations of 


"Matter of the Jurisdiction of the Board of Examiners 
of the City School District of New York and the supervision 
and control of teachers' examinations, State Department 
Reports » (1922): Matter of the Investigation of the 
Board of Examiners of the City of New York by the President 
of the Board of Education of such city as a Committee of 
one appointed by said Board. State Department Reports 
(1926). Attached as Exhibit tt 2, M&A 2a, 
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the scope of examinations, the preparation of examination 
materials, the election of tests, and the determination 
of. pass marks, the Board of Examiners acts as an indepen-| 
dent and statutory body subject Only to the Jurisdiction 
of the Commissioner of Education and the courts. 

. 11. With respect to the nature and type of 
licenses and with respect to the educational and experience 
requirements for licensure the Board of Education has sole 
Jurisdiction.# : 

ee The specific duties of the respective posi- 

i tions established by the Board of Education are set forth 
by the Superintendent of Schools. The Board of Examiners 
develops the content of examinations in consonance with 
the duties of the position as established by the Superin- 
tendent of Schools. For example, if the Board of Educa- 
tion and the Superintendent of Schools stress the duties 
of community relationships for principals, the Board of 
Examiners would give great weight to this aspect in the 
examination process. 


13. Examinations are announced by the Board of 


Examiners at the request of the Superintendent of Schools, 


Pursuant to such a request, an examination for license as 
principal of day elementary schools was announced on 
September 11, 1970. It was requested by the then Acting 
Superintendent of Schools, Mr. Irving Anker, with the 
recommendation that the examination te completed, if 
possible, by February'l, 1971, or at the latest in the 
Spring of 1971. 


"Under the new Decentralization Law effective July 1, 


1970 ‘these powers are vested in the Chancellor. §2570 3, 
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14, The eligibility requirements, the scope 


of the oxamination and other relevant date are set forth 
‘nian Examination Announcement, dated Septeaber xa, 1078, 
8 copy, of which is annexed and marked Exhibit "3", 
Appended to and part of this announcement is a statement 
of the duties of the position of principal of a day 
elementary echool as set forth by the Superintendent of 
Schools and submitted to the Board of Examiners as a 
guide in determining the scope of the examination, the 
nature of the tests to be administered and the content of 
the tests. ; 

15. The final date for filing applications 
for this examination is October 7, 1970. The written test 
‘of. the examination is scheduled for November 3, 1970, 

&@ national holiday.* It is the announced intention of 
“the Board of Examiners and the office of Teacher Personnel 
of the Board of Education to conduct written, interview 
and medical tests in this examination at a site in Puerto 
“Rico, as well as in New York City, in order to make it 
possible for eligible residents in that area to take 

the examination. 

16. It is anticipated that more than 2,000 
persons are eligible and will be applicants for the exam- 
ination. Included: among the estimated 2,000 applicants 
expected to file, are 1,437 participants. in the Professional 
Promotiona: Seminars condusted by the Board of Education. 


These seminars were established several years ago by the 


Examinations are scheduled for such dates in order 
not ‘to conflict with normal business of the schools, 
Saturdays or other religious holidays, etc, ' 


49a 

| Deputy Suporintendent for Personnel upon the recounonda~ 
tion of the Board of Examiners in order to provide free 
assistance in ‘developing individual eulibehionns in: super- ' 
| Vision and administration with a view towards completing 
‘successfully the various tests in examinations for 
supervisory licenses. 

17. The seminars for preparation for the 
examination for license as principal of day elementary 
schools were begun in the spring of 1970, continued 
during the summer and are now still in progress. They 
are conducted in seven centers, six of which are located 
in low socio-economic areas, such as South Jamaica, 

South Bronx and the Bedford-Stuyvesant section of Brooklyn. 
These sites were selected in order to encourage minority 
group participation. 

18, The project director of the Board of ini 
tion seminars has stated to the deputy superintendent of 
teacher personnel that among the 1,437 persons now par- 
ticipating in the seminars in the various centers, 
Approximately 330 are identified as black and Puerto 
Rican. 

19. In addition to this examination, many 
other supervisory examinations have been conducted, are 
being conducted and are projected by the Board of 
Examiners. Ae tuanimitin, péhdit, alailedl a. WhO? Y, 

20. Plaintiffs seek to badoin the giving of 
all of the foregoing examinations yet they have not 


shown that they would be harmed in any way if the exam- 


inations continued as scheduled. By their own statements, 


i 
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plaintiffs aoeeee to be eligible for the instant examina~ 
‘tion and indeed have filed to. take the ‘Sxamination. If 
they pass, they will be placed on an eligible list for 
Gppointment to the position of principal of day elementary 
school. If they fail and contend that such failure was 
the result of discriminatory examination procedure, they 
haye ample relief thro:<!; the appeal proceedings of the 
Roard of Exaihiners, the Commissioner of Education, the 

‘ate Commission on Human Rights, the New York City Human 
Rights Commission and the Courts of the State of New York. 
Certainly they cannot claim to be aggrieved until they can 
contend that they have failed and that such failure was 
the result of discriminatory examination procedures, 

21. While an injunction is not required to 
protect the interests of plaintiffs, enjoining the 
Board. of Examiners as requested by plaintiffs would result 
in severe disruption of the entire education process in 
the City of New York. The present eligibility list for 
elementary day school principal has been exhausted. Over 
2,000 candidates have applied to take the principals exam. 
To prevent them from doing so would injure the school o. 
system and the children attending the schools in that it 
| would deprive those schools of appropriate leadership in 
supervision, in administration, curriculum direction, 


and relationship with parents and the community. Plain- 


Liffe suggest that persons could be:assigned in acting 
capacities to fill the void. However, it is self-evident 


| that an acting principal or other acting supervisor is not 


5la 
in & position to act with the continuity, authority and 
assurance that come with appointment to & position and 


the resulting tenure in office. Further in view of the 


_ extreme difficulties faced by our schools, school boards, 


students, parents, teachers and administrators in a 


period in which we are moving from a centralized school 


system to one which will be decentralized, she availability 4 


of licensed and qualified personnel for immediate place- 


ment in schools is essential. 


22. . ditionally, the Education Law, Section 


i 2569, requires that the defendant Board of Examiners 


hold examinations whenever necessary, examine all appli- 
cants who are required to be licensed or to heve their 
names placed on eligible lists for appointment, and to 
prepare all necessary eligible lists. Should a preliminary 
injunction issue in the instant Case, the resul vould 

be that the Board of Examiners would be prevented from 


performing the duties imposed upon it by law and requested 


| of it by. the Board of Education and by the Chancellor. 


23. The critical importance of holding examina- 
tions as scheduled is emphasized by the following addi- “ 
tional considerations: 


(a) The State Education Law requires that 


| vacancies in the public school system of New York City 
j be filled within six months. Since a large number of 


vacancies in supervisory posts are anticipated as a 


result of expected retirement, postponement of the 


instant examination would result in violation of State 


| Law. 


— 


1 the written test resulting in outraged protest from 
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(b) ‘As a result of the: liberalized pension 
benefil granted by the legislature in 1969 it is antici- 
pated that more than 50% of the present supervisory staff 
will have retired within the next four years. Many of 


those will have retired within the next year or two. 


= aceanaeEate RON scm NN eTe 


This explains the concern of the evting Superintendent 


of Schools for the promulgation of a list of principals 


in day elementary schools not later than the spring of 
1971. It would be an unnecessary hardship to postpone the 


announced examination as well as for other supervisory 


; examinations when the need is pressing now and will 


| become much more acute within a short time. 


(c) This examination has already been cancelled 
once. It was originally announced on August 28, 1969 
and was then cancelled at the request of the Superintendent 
of Schools in order that the requirements for eligibility 
for the position be reviewed with a view towards liberal- 
ization.* This examination was cancelled by the Super- 


intendent of Schools two weeks prior to the conduct of 


1,300 individuals who had filed in good faith and had 
made preparation. To cancel the same oxamination a second 


time under similar, circumstances would indeed do irrepar- 


| able damage to all prospective applicants. 


(4) In addition to and including the prospective 


| applicants who prepared themselves for this examination 


| 
| 


through professional seminars are those prospective appli- 
‘ 


cants who in good faith undertook to make themselves 


YThis Liberalization was effectuated for the express 
purpose of including more teachers representing minority 


groups within the eligibility vequiremeots for the exam- 


} ination. 
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eligible and onakt fied by taking appropriate courses ona. | 


training in various cOlleges and universities witn con- 
siderable expenditure of time and morey. Such preparation 
may be vitiated &S @ result c* the postponement of the 
instant examination, 

‘ (e) Those applicints for other supervisory 
examinations who are awaiting the promulgation of eligible 
lists or appointment from existing eligible lists to 
vacancies would suffer irreparable injury in loss of salary, 


pension and seniority rights. 


24, The content of the written test for the 
examination scheduled to be given on November 3, 1970, 
which is in th nal stages of preparation, like all 
examinations given by the Board of Examiners for super- 

| visory positions is entirely relevant to the duties of 
the position as established by the Chancellor and as set 
forth in the by-laws of the Board of Education and as they 

} @ppear in the examination announcement circular (Exhibit 
“"3"), Such examination is in no vay discriminatory 

) towards blacks or Puerto Ricans. In view of the accel- 


| erated rate of blacks and Puerto Ricans entering in the 


} School system and in view of estimates by the Division 
| of Personnel, it is likely that substantial numbers of 
} blacks and Puerto Ricans will take the examination and 
| be successful. 

| Sworn to before me this 

1g day of octover, 1970. 
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i UNITED SYA'TES DISTRICT COURT 
SOUTHERN DISTRICT OF NEW YORK 
| 


| 
: =X 
BOSTON M. CHANCE and LUIS ¢, MERCADO, ‘ 
et al. « aaa a7, r | 
" Civ. No.4141 | 
Plaintiffs, . Index No. 70 
~against~ : 
¥ . e i 
| BOARD, OR EXAMINERS, et al. , SEDANS 
| Defendants, , 


| STATE OF NEW YORK ) 
eo! 


fl Oy eos S33. 
COUNTY OP -NEWyoAy_) 


MURRAY ROCKOWITZ, being duly Sworn, deposes and 


says: 
1. I am a member of the Board of Examiners of 


the Board of Education of the City of New York, and one 


of the defendants herein and submit this affidavit in 


opposition to plaintiffs’ motion for 4 preliminary in- 


Junction. 


he Board of Examiners 


in 1966. However, I Have been p 


2. I became a member Of th 
part of the New York City 


school system Since 1939, holding a great Variety ef 
t of teacher and including 


assistant principal of a Junior high‘school, chairman of 


&@ high school English Department, principal of an elemen~ 


| tary school, principal of «4 Junior high school, and 


principal of an academic high 


A tae 
School. 


licenses beginning with tha 
| 
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3 I hold a B.A. degree from C.C.N.Y.3 M. A., 
New York University; M.S. in Education, C.C.N.Y. and 
Ph. D. ‘th Educational Administration and Supervision, N. T.0. 


a: _As a member of the Board of. Examiners, my 


primary responsibility is as Examiner in Charge of Research 


and Development. This function includes the Pesponsibtiity | 
i for conducting cualecca of the validity and reliability of 
-|the tests given by the Board of Examiners and @ review of 
the administrative procedures involved tn the conduct of 


such tests. Additionally, I consult with the units of the 


Board of Examiners which conduct examinations in such fields 
as foreign languages, inusic, art, health and physical 
education, guidance, social work, psychology, special 
education and psychiatry, among others. In the course of 
fulfilling the foregoing responsibilities, I have become 
familiar with all aspects of the Board of eee 


testing activities 


_ OBJECTIVITY OF EXAMINATIONS 


5. The plaintiffs in this ection have alleged 


that "The testing protedures of defendant Board of Examin- 


ers, beirg neither objective nor being measurements of 


ah merit and fitness for the particular Jobs involved, and 
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yet. being a basis for promotion in the civil service, are 
conducted in violation of Article V §6 of the ‘New York State 
Constitution and §2590-4 3(a) (1) of the New York Education 
Law." This allegation is totally without merit and lacks 
even the slightest foundation in fact. In point of fact, 
the testing procedures of the Board of Examiners are clear- 
ly objective measurements of merit and fitness for the 


jobs involved. The term "objectivity" has been defined 


that eliminates, as far as possible, the inflvence of the 


examiner's bias or opinion." English and English, A 


cal Terms. (heng mans, Green and G. New York, 1g.) 


6. The procedures used by the Board clearly meet 
the aforesaid definition. 
(a) Applicants cannct be identified by the 
test scorer. The identity of the applicant can only be Q 


determined by reference to a code book which is punched on 


his papers. The test scorer does not have access to the 


code. - 


(b) “Answer papers are not only anonymous but 


they are machine scored. P 


(c) Questions for a single test are submitted 
iby a number of experts on a number of topics to eliminate 


any individual bias that might exist. 


as "a means of measuring individual differences in behaviour | 


Comprehensive Dictionary of Psychological and Psychoanalyti- 
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"(a) Essay questions are rated by different 


committees so that no one individual is responsible for the 


‘| rating of an entire examination, 


» 
. 


‘(e) Detailed, objective rating guidance are 
prepared for the rating of each question. These guides 
| are extremely detailed in order to eliminate, insofar as 
possible, the chance o:' individual bias. (Sample attached 


fas Exhibit /...Standard Answer and Rating: Directdons attached 
as Exhibit 1 4./ © : 
(f)> On interview tests for supervisory 


4 positions, panels of three experts are generally used to 


provide for a pooling of judgment. (Interview Test Guideline 
attached as Exhibit 1 b.) 
7. The judgment of the Board of Examiners that 


its testing precedures is eminently objective has been con- 
firmed by numozous experts in the testing field. Professor 
Robert L. Thorndike of Teachers College, Columbia University 
perhaps the most renowned authority on the subject in the 

} country, has said with regard to the objectivity of the 
Board's procedures: 


"Such procedures as never identifying 
the examinee by name on a test paper, 
providing the reader of the paper with 
a scoring guide indicating the kinds of 
4ssucs to be dealt with and the credits 
to be allocated to each (and so forth = 
sic) [insofar as] possible, and these 
precautions appear to have been sys- 
tematically and scrupulously observed 
by the Board of Examiners in their 

~ testing procedures. Though the assess~ 
ment procedures carinot claim to be fully 
objective in the sense that any observer 
and/or reader would automatically arrive 
at the same score or the same evaluation 
of the person being observed, they are 
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objective and they are impartial in 
the sense that the scorer of a test 
paper is responding only to the answer 
provided to the question, and that the 
interviewer in an interview situation 
_ ds responding only to a person who is 
not known to him. ... Within the 
, limits of the possible, the Board of 
Examiners appears to have made a 
conscientious: effort to make sure that 
partiality and partisanship do not enter 
into the evaluation of the responses to 
the tasks that they have set the 
examiners." (Affidavit of Professor 
Robert L. Thorndike, attached as 
Exhibit *)) 
Similarly, other eminent experts in the testing field have 
' reviewed the Board's procedures and examinations and have 
concluded that such procedures and examinations are objec- 
tive. (Affidavits of Professor Marvin Sontag, Columbia 
University, ‘attached as Exhibit Hd); Professor Aaron Suss 
Carton, State University of New York at Stony Brook, at- 
tached as Exhibit *(c): and Professor Esin Kaya Carton, 
t 


| attached as Exhibit 2(d)). 
‘ VALIDITY AND RELIABILITY OF EXAMINATION 


8. The plaintiffs allege "The veneing procedures do, 
not indicate a candidate's ability to ‘do the job bern 
tested dor (sic). There is no evidence that they measure 
merit or fitness, they have never been validated, and they 
are unreliable psychological se SPREE EET (Paragraph 23, 
Amended Complaint.) 17 “allegations are ‘totally unsupported 
by fact and are outrageous false assertions in view of the 
Board's intense efforts to insure the relevance and validity 


of its examinations. 


9. While prior to 1967 the law did not specifically 
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lanclude & requirement concerning "validity and reliability," 

| the Board or Examiners has for _— years ————— 

' | conducted such reviews. : 

|  * 40. me concept or "validity" as 1t applies to 
Jexaminations is susceptible to more than one definition, 
Tie plaintiffs, in its brief, asserts that “ne test of 
[validity is "one ‘that tends to predict Job performance.” 
lpraintires' Memo, page 7.) Such a validation standard might 
| be applicable if the tests given by the Board of Examiners 
were aptitude tests, i.e, a test designed’ to determine the 
potential of the individual for training and for developing 
the knowledge and skills for a particular job. In point of 


fact, the Board of Examiners gives tests to determine the 


wr ec 


applicant's ability: to perform and not his aptitude to learn. 


Accordingly, the so-called "predictive validity" tests sug- 
| eestea by plaintiff are inappropriate for the work of the 
Board. The Board seeks to validate its tests by matching 

| the knowledges and skills it examines to the duties of the 
Postion being sought. 


eae In: addition to man eeren concerning validity, 


the Board insures the validity of its tests by the methods 


the position. For: each examination, the Board of Examiners 
| obtains from the Board of Education Getailed analysis of the 
| Job an question, These aré called the "duties of the 

| position.” (Same attached as ExhibitS) A committee of 


} 

| 

hat has devised to make the tests relevant. to the duties of 
| 

| 


lexperts is assembled to select the most significant duties’ 
| : 


} 
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(job responsibilities) of the position to be tested for. 


Well known interested lay persons may be consulted for their 
wivies on the qualities being tested foe in a particular 
test. Thus, for the Elementary “School Principals examina ' 
tion in question a committee was assembled last December 12, 
1969 attended by: 3 


Dr. Aaron Brown, Professor of Educ ation, 
‘Long Island Univers:ty. 


Dr. Richard Campbell, Director of Personnel 
Research, American Telephone & selegregh Company. 


Dr. Sona Maleska, Associate Director, Center : 
for Urban Education, 


-Mr. Martin Mayer, Author; Chairman, Local 
School Board No. 2, 1962-67, 


‘Professor Priscilla Pemberton, Bank Street College. 
Dr. Herbert Schueler, President, Richmond College. 


Poter J. Strauss, Esq., Attorney, Membor, 
Local School Board No. 2, 


Mr. Howard Saronsen, Principal, i. & 24, Richmond, 

Mr. Edmund Zaslow, reeneteet P, S. 115, Queens. 
With. vhe help of such committees of experts and lay persons, 
Questions are devised to test the knowledge and skills of 
applicants in realistic (close to actual job conditions), : 
Situations and problems which are based on the statement 
"duties of the position. " 

hee. Every effort is made to be sure that the 
questions on the examinations are relevant and relate to 
Specific duties of the job. 

a3. An analysis of two examinations, one for 


high school principal and the arher for elementary principal 


pis attached which clearly shows hes each and every question 
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in the examination is related specifically to a duty called 
for by the Board of Education's stetoment of duties of the 
position. (Exhibit 4A ana B) : Le 

. 14. - The procedures of the Board of Examiners in 
developing tests and the tests themselves have been reviewed 
by eminent authorities in the field of testing. Such 
authorities, without qualification, have found the Board's 
tests and procedures to be valid and reliable. (See Exhibits 
2 aj) <) d) ) Professor Thorndike of Columbia has said: 7 

"In general; the Board of Examiners appears 

to have made a conscientious and informed 

attempt to develop test tasks that do cor- ' 
respond to selected ones of the specifica- 
tions set forth by the supervisory persons 

who set out the requirements for the job." 

15. It should be clearly understood that the 
Board ‘of. Examiners does not determine the duties fox the 
Job nor does the Board of Examiners determine the eligi- 
bility for the job. Such duties and eligibility requirements 
are determined by the Board of Education through the Super- 
intendant of Schools (now Chancellor). The Board's function 
is to develop Sbjective, valid and reliable examinations td 
test eligible applicants regarding the prescribed duties.. 

16. .In addition to the establishment of pro- 
cedures which insure the constant review for validity and 
reliability, the Board of Examiners has regularly conducted 
research in an ertoxt to‘ improve its testing procedures. 


Such research has been carried on for many years and is in- 


corporated in numerous published and unpublished reports. 


63a 


’ j 
(Buces fF Exawiaees, Mew Yort New Youd m>? 
E Teacher Selection Methods? fn Analysis of Kxamina- 
——————————eeeey 


: 166 OF 
tion for Principal of Elementary Schools.) (unpablishet) 


17. Since 1967, the Board has conducted many 
research studies which seek to determine the validity and 
reliability of such tests as the written test (essay and 

i Short answer), supervision test, the written English test, 
iu tnberview test and the oral appraisal of observed 
teaching tests. The recommendations emanating from such 
asses hav: regularly been utilized in a continuing effort 


| 
I to improve examinations. For example, the written English 


beat of 450 words, which requiresl-1/2 hours, was reduced 
Ito 350 words, requiring 1 hour, after research had demon~ 
strated the validity of such reduction. This saving of 
itime and money has applied to many thousands of applicants, 
Further, while providing for continued improvement, the 
research has confirmed the validity and reliability of the 


Board's examinations. See Summaries of Certain Research attached 
as Exhibit 4 ec. 
18. The plaintiffs’ suggestion that the current 


Study funded by the U.S. Office of Education is the "first” 
it (the Board] has ever done" is an insult to the intelli- 
gence and integrity of the Board of Examiners as well as to 
the efforts of the ‘researchers involved in its many re- 
search activities. The bald assertion by the plaintiffs 
that the Board has never complied with Section 2569, sud- 
division l,of the New York Education Law is patently false. 
(Paragraph 27, Plaintiffs' Amended Complaint.) 
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19. The requirement of the ‘plaintiffs that "tests|' 
be prepared and validated in accordance with the latest 
standards of professional psychological testing" reveals a 
profound ignorance of the literature of professional test- 


ing. The plaintiffs presume that there is a single uni- 


versally agreed upon standard for testing and that there 


i 
i} 


| 1s a revision of this single standard periodically so that 


a "latest" one exists. Any expert ‘in the testing field 
knows that there are many such acceptable standards and 
that the term "validity" refers to a test's being valid for 
fg particular job or situation. The Board of Examiners, 
through a licensed School Research Associate who holds.a 
doctorate in research is kept constantly aware of new 7 
developments in the field and embodies these, where appli- 


cable, in its tests. 
20. In his affidavit, Dr. Barrett reveals a 


profound ignorance of the procedures of the Board of 


' 


Examiners. He evidently has not taken the trouble to in- , 
form himself about them. Indeed, his affidavit recommends 
a procedure which has been followed by the Board of Exam~ .. 


iners for many years, viz: 


"Some of the essay questions on this 
examination and on the 1964 examina- 
tion for principal, day elementary 
school, present problems which appear 
_, +to be related directly to school 
i “practice, and their inclusion might 
be justificd on the grounds that they 
have content validity, that is, they 
: might constitute a valid work sample. 
If they have content validity, they 
: have the kind of inherent validity 
that a good typing test has for a 
} typing job. However, for a test at 
this level to be justified on the 
basis of content validity, it is 
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‘necessary that the Job ‘be. analyzed, 
.g00d and poor performance: defined, 
‘questions relevant to significant 
aspects of the job preparr’, level 
of acceptability of answe)s defined, 
and test scorers trained and super- 
vised." (Paragraph 4 of affidavit 
of Dr. Richard S. Barrett, page 3.) 
Dr. Barrett's sampling of the hundreds of supervisory 
examinations conducted by the Board of Examiners in recent 
years is confined to two, hardly an adequate number. In 
analyzing one of them, he confines himself to fewer than 
ten items of a 205-item short answer test. Further, he 
makes no inquiry whatsoever into the outcome of the examina- 
, tion and its effect on the population who took it. 
| Dr. Barrett also reveals an ignorance of appoint- 
ment procedures of principals under the new Decentraliza- 
tion Law (Chapter 330 of Laws of the State of New York 1969) 
When he insists that the work of a principal varies "With 
the level of the school," the "socio-economic and ethnic 
make-up of the student body," ete., he is apparently un- 
aware that qualified principals, under current law, may 
be interviewed by Community School Boards to determine the 
suitability of that eligible principal for a given school., 
Dr. Barrett further reveals a lack of knowledge 
of the procedures of the private employer he cites, namely, 
the American Telephone and Telegraph Company. He says 
that their "selection procedures make little use of the 
type of questions typical of the supervisory tests 4 
examined for purposes of this affidavit." The contrary 1s 
true. “The American Pelephons and Telegraph Company includes 


written tests which are designed, among other purposes, to 


| determine the knowledge of prospective executives of 


€ 
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world affairs and current events. I make this statement on 


the basis of a personal visit to the assessment center to 


| 

| which Dr. Barrett refers. | 
. 

. Thus, it is apparent that Dr. Barr tt has based 

} 


his judgment and has formed his opinion on a complete lack 


| of knowledge of the procedures of the Board of Examiners, 
on a lack cf awareness of how principals are currently _ 
| selected for assignment to schools, and on an incomplete 


| 
aeel of the selection procedures of the private 
| employer he cites. 

} 


} 
ba | 


| tiffs have attached, 


rat] 
0) 


Exhibit "B", an article by Gregory 


| 
{ 
' 
21. In support of its allegations, the plain- 
| Jones in 6 Columbia Journal of Law and Social Problems, | 


{ 
| 
pase 374. That article purports to quote statements made 
ag me in an interview with Mr. Jones. The article is re- 
' 


accuracies. Attached hereto as Exhibit 5 is a review of 


some of Mr. Jones' more egregious misstatements. 


| 
| 
| 
| 
plete with false statements, misquotations and other in- 
4 A manne” Ad ites | 
semana TTS Tid 7 a 
irray” Rockowitz | 
| all 
Sworn to before me this 
Ss 


Ae Gy of October, ei 


2 ¢ 


| ef ‘Ce 
} Commies'arer of Or7"s, Cty off 
{ Kings County Cicik - 4, 2 st 

\ Commision Expires Juns 24, 1972 


| 
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Affidavit of Robert Thorndike verified on October 
9, 1970 ‘attached as Exhibit 2a to Rockowitz 
Affidavit) 


Exhibit Ps a 


TEACHERS COLLEGE COLUMBIA UNIVERSITY 
NEW YORK, NEW YORK 10027 


: : & J 
| ’ Co Liat Ae 
. . s . ’ 
OEPARTMENT OF PsYCHOLOGY : 


8 october, 1970 


Dr. Murray Rockowitz - 
Board of Dxaminers 

New York City Schools 

65 Court Street ; 
Brooidlyn, New York 11202, 


Dear Dr. Rockowitz: 


My name is Robert Thorndike. I have taught courses in measurement and test 
~onstruction at Teachers College, Columbia University for over 30 years, I 
em the author of several books on personnel selection and educational and 
psychological testing, ‘The following statement is based upon discussions 


with you and inspection of various documents relating to the specifications 


‘for, content of and enalysis of exeminations for principal and assistant 


principal. 


ra “ 


general types. On the one hand there are aptitude tests, These are tests 
‘hat undertake to measure potential of the individual for training and for 
developing the knowledge and skills that are necessary on @ job. Thus, a 
test of finger dexterity or ¢f speed of finger movement might perhaps serve 
as an aptitude test for a tyzist in that these underlying motor skills might 
be shown to be related to rate of learning to type or to level of competar. :e 
in typing eventually developed. On the other hand, some tests should be 
Classified as proficiency tests. These are tests that measure some aspects 
of the knowledge and skill that are called for on the job itself. ‘Thus, a 
typing test in which a typist was called upon to transcribe dictated letter 
from & tape accurately and with correct spelling and correct placement on 
the page would be classified as a proficiency test for a typist, : 


Tests for the selection, classification end : lacement of personnel are of two. 


As I view the tests that are prepared by the Board of Examiners to place 


‘individuals on the list of those eligible. for appointment as elementary 


school principal, it seems clear to me that these should be thought of as 
proficiency tests rather than aptitude tests, They endeavor to test some 


“espects (obviously not all) of the knowledge and skill that the principal 


will be expected to use upon the job. They are measures of the extent to 


Which he has learned the requirements of the joo, rather than tests of his 


underlying potential for later developing the knowledge and skill after a 
program of systematic training. - oa rs 
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Te stondards for evaluating aptitude tests and ‘for evaluating proficiency 
tests are quite different, Aptitude tests are primarily predictive, and 

_the only basis upon which \they can be evaluated is whether and to what exe 
tent they do in fact predict later progress in training or later development < 
of competence and proficiency, Proficiency tests, on the other hand, are 
designed to appraise current competence. They must be evaluated in terms 

of the extent to which the asvects of knowledge and skill called for by the 
Sests do in fact match aspects of knowledge and skill called for in the. 

job for which they are designed, The appropriate criterion by which the 
tests are evaluated is the validity of the content of the test, in terms of 
its match to the specifications of knowledge and of skill called for in Job 
performance, and a consideration of prediction is secondary, if it is of any 
importance at all. If one undertakes to eveluste the principals’ examination 
as 2 proficiency test, the question that one must answer is how well the tasks 
called for by the test represent certain requirements of the job. 


One undertakes to develop a content-valid proficiency test by setting forth 

fully and explicitly the requirements of a joo and then by developing pro- 

ficiency test tasks that corresrond ta those requirements, This is the 

gencral pattern that the Board of ktaminers has followed in their efforts 

to develop tests such as the principals' examination. A statement of job. — 

requirements has been developed, based -upon the pooling ef judgnent of high 

level supervisory gersonnel i: the Board of Education, with, some review by 
-comittees of educators and civilians. ‘he specifications ere reasonably 

full, They are based upon the background and experience of educators who 

have worked with elementary school principals in New York City over a period 

of years. In this sense they represent the pooled professional judgment of 

persons with a good many years of experience in the New York City educational 

system, Tais statement of requirements is available to candidates as they 

prepare for. the test and it also guides the test-makers as they prepare test 

tasks. The closeness of match between the tasks as set forth in the exemina- 

tion end the duties of the job as sect forth by the supervisory personnel in 

the city system can be evaluated only by informed judgment, not by statistics 

or manivuletion of numbers, It is a judgnent arrived at by examining the 

statement of requirements and vy looking carefully at the questions together - x 
with the procedures set up for evaluating answers to those questions, In 
general, the Board of Exeminers appears to have made a conscientious and 
informed attenpt to develop tcst tasks that do correspond to selected ones. 
of the specifications set forth by the supervisory persons who set out the 
requirements for the job. 


\Ooviously, it is possible in any Limited pertod-ef time to test only some 

‘of the rcouirenents even if all of them could be reduced to a-paper-and-pencil- 
—test-or toon interview situation. —Necessarily, any-test represents a sate - 

pling of Job duties and represents a sampling from among those that can be 

reduced “> a paper-and-pencil or interview testing situation. Within these 
““yinits, the tasks that are represonted-in-the test items appear to me to be 

xcasonable tasks as representing selected ones of the job requirements. 


“A different end secondary issue With vesveet-to tests as personnel selection . 
@evices bas to do with the objectivity and reliebility of the testing pro~ 
cedures, There is a busic trade-off involved here, in that simple knowledges 
and simple information can be tested very reliably and objectively but that. 


— 


. 


made on each, Within the limits of the possible, the Bo 
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performance on tests of the more complex syntheses of knowledge and judgment 


required in actual functioning on & job can be evaluated only by judgment, 
It is impossible to reduce a complex response to a complex situation to a 
mechanically-scored multiple-choice Kind of key. Consequently, in proportion 
as tne test tasks become réalistic and move towords dealing with a fairly 
complex synthesis of infommat.on and judement, the appraisal of responses to 
Aom becomes necessarily also dependent upon the pooled judement of appraisers, 
Tacre, a varicty of steps can be taken to make for consistent judgment on the 
part of the aporaisers end to guarantee that the appraisal is in terms of the 
response itself rather than in terms of the person responding. Such procedures 
es never identifying the exomince by name on & test paper, providing the reader 
of the paper with a scoring guice indicating the kinds of issues to be dealt 
with and the eredits to be allocated to cach and so forth are possiole, and 
these wrtesutions appear to have been systematically and scrupulously observed 
by the Board of Examiners in their testing procedures, Though tne assessment 
procedures cannos claim to be Fully objective in the sense that any observer 
or ony reader would automatically arrive av the same score or the same evelua- 
tion of the person being: observed, they are oojective and they art imartial 
tn the sense that the scorer of a test paper is responding only to the answer 
rar 


provided to the question,\ and that the interviewer in an interview situation 


4s responding only to a person who is not Known to him. Also, in cach instance, 
the scorers and interviewers are judging in terms of e-olicitly defined guides 
as to the qualities to be observed and the kinds of allocations of credit to be 


a of Examiners e@ppears 
to have made conscicntious efforts to make sure that partZality and partisenship 


do not enter into the evaluation of the responses to the tasks that they have 
set the examinees, ; 


Ver 
4; 


Robert L. Thorndike 
Professor, Psychology and Education 
RLT 212 
| .* 
Appeared before me this 9th day of ...: , oo 


October 1970 


=e. 

HA a Ch Pe tetgdrt 
Greece Mason 
Notary Public 
: GARAGE MASON 
ROTARY FULCIC, STALE GE MCVE TORK 

Ho. 31-7752175 

Quailfied in iow Yors County 

Commission Expires March 20,1972 


Affidavit of Marvin Sontag verified Octover 12, 1970 
(attached as Exhibit 2b to Rockowitz Affidavit) 
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TEACHERS COLLEGE COLUMBIA UNIVERSITY 
“NEW YORK, NEW YORK 10)27 : 


OPPARTMENT OF pee . : Cy fit 4. f- 


2.7 
UNITED STATES DISTRICT COURT 
FOR THE 


SOUTHERN DISTRICT OF NEW YORK 


BOSTON M, CHANCE and 
‘LOUIS ¢, MERCADO, et al, 


Plaintiffs, 


Deféndants. 


SAcnenananssnssanssanaaabh ee mnaammanm ama m2 mee 


AFFIDAVIT IN OPPOSITION TO 
MOTION FOR PRELIMINARY INJUNCTION 


Dr. Marvin Sontag, being duly sworn, deposed and says: 


- 3. aman Associate Professor of Psychology. and Education at feachers 
College, Columbia University. : 


~~. 
2, Asa member of the Psychology Departwent in this school, T teach 
-. courses in Educational and Psychological Measurement, as well 4s 
Research Methodology. : 


- [have served as consultant to the New York City Board of Examiners 
on both the preparation of written examinations and the administration 
of interview examinations. 


prior to my appointment to Teachers College, I spent approxim sely 

. twelve years with the Bureau of Educational Research of the New York 
City of Education, My last position with New York City was - 

. that of School Research Psychologist. 


Se 


oc 


- yx tae quality of the examinations conducted by the 
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At the request of Dr. Murray Rockowitz of the New York City Board 

of Examiners, I have prepared this affidavit stating my impressions 
Board of Examiners. 
Myst, I would like to address myself to the question of the validity . 
of <1.2 examinations. In any procedure for selecting ‘from emong job 
applicants, two basic approaches are possible. | The first is to test 
the proficiency of applicants in a nunber of areas deemed important 

to the job, ranking the exwminees according to their proficiency as 
measured at that\point in timé. The second is to relate these meacurer 
to some criterion measure of job success taken after applicants have 
had the opportunity to function on the job for a period of time. The 


‘Inter. procedure ig employed to determine predictive validity. While 


4n the abstract this second approach may appear desirable, a question 


. remains as to whether or not such an approach would be truly practical 


for an organization such as the Board of Exaniners , since large numbers, 
of applicants who nad already been examined and appointed. to the posi- 
‘tion would be required, as well as good criterion measures of profes- 
sional competence. It would take about 20 years to collect an adequate 
sample of appointees, for most licences, and the literature is clear 

in the paucity of good criterion measures, In addition, the instrument 
for such a study should be preferably t @ same or closely similar for 
ell subjects, and a long term data collection program with the same 
4nstrument would run the danger of a security leak. I would therefore 
conelude that in the practical world of/ the New York City Board of 
Education, the decision to de-emphasize predictive validity is a wise 
One. . ee eee ‘ . / 


ae ers 


In the measurement of proficiency, th most accepted procedures for 
achieving validity are to: prepare & careful job analysis; determine 
the skills necessary for the job; and/ test as wide a sample of these 
skills as possible. As the job descriptions accompanying all test 
applications are a matter of record, /I shall not comment on them here. 
In determining the skills to be measured and in preparing the test 
items, the Board of Examiners routinely consults panels composed 

of both persons holding the particular jobs and wiiversity professors — 
with expertise in the pertinent areas, Thus, & conscientious attempt 
ds made to combine both practical and theoretical viewpoints, This ~ 
thinking is kept current by employing a new panel each time an exeminae 
tion is offered. While no one can’argue that the products are always 
perfect, this approach is all that! can be hoped for in such a situation. 
It represents an henest attempt to achieve relevance and validity, and 
4¢ allows the examination to reflect changes in thinking regarding the 


- mature of a particular job. 


“Gojectivity, as formlly defined, is the extent of agreement among 


judges. [In tests of the multiple-choice type, objectivity is not 


really an issue, since anyone applying & key will come up with sub< 


stantially the same result,- ith machine scoring as employed by the 
Board of Examiners, the issue becomes dlitost-non~existent. 
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9. In the case of essay exominations, coneerns for objectivity become 
important, % us consider for a moxent the steps recommended by 
most experts to insure objectivity on an essay examination. These 
dncluce : 

&. irsuring the enonymity of the applicant, 
be. preparing keys in advance in as specific fashion 

as possible, = 
¢, assigning weights to each response in advance, and 
d. scoring one item at a timo, 


Ist one compares, the procedures of the Board of Uxaminers to this list, 
it is quite evident that ereat pains have been taken to insure objece 
tivity. As papers are identifica by an anonymous perforated number, 
the scorer docs not see the name of any applicant, All answers and 
weights are specified in great eactail and reviewed by @ panel prior 
to their use. All responses to a single item are scored by a single 
panel, and, in most instances, different examiners score different 
questions, Agein,| in the case of the written examinations, I would 
rate the procedures taken to insure objectivity as excellent, 


10, In the case of interview examinations, the task of obtaining objectivity 
becomes more difficult, Nevertheless, training sessions for interviewers, 
operational definitions of the traits being rated, and the use of at 
least two examiners for each interview represent a superior approzch 
to this problem. The addition of a tape recording for review of the 

. interview in questionable cases is enother important step in the direce 
tion of objectivity. i 


i. The routine review of all cases that come within ten (10) points of 
passing as well as an anpeal procedure for failures are further testi- 
mony of the claim that superior procedi tes have been adopted to insure 
objectivity. aay ' eG 


Sicmed and sworn before me 


“nis 12 aay of ~ October 1970 


Notary Fuolic PAUL! RENAULT 
“Notary Pudiic, Sintec of New York 
> PResiding In Noszas Co, No, 20-8545-109 


Commission Expires March 36, 13972 


\ 
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Affidavit of Aaron Suss Carton verified on October 
25, 1970 (attached as Exhibit 2c to Rockowitz 
Affidavit) 
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My name is Aaron Stiss Carton. T reside at'3 Hunter's Court, 
Setauket, New York, I am Associate Professor of Education at the State 


University of New York at Stony Brook. I have been engaged in educational 
research.almost continually for the past 12 years in a variety of capacities. 
Problems of measurement -“ testing were an integral part of my research 
and in the field of foreign language education I have participated in the 
development of tests and conducted evaluation programs, Alone, or : 
in collaboration, I have produced h.uorous reports and articles in pro- 
fessional journals, 
The Board of Examiners of the Board of Saueation of the City of 
New York has requested my professional assessment of ite testing procedures, 
My sources of information about these procedures consist of: (a) a briefing 
by the Board of Examiners which consisted of a description of the history 
of the Board, a description of its policies and procedures and a period of 
intensive questioning by participants where all questions were answered 
completely and candidly; and (b) inspoction of a large sampling of documents 
which included descriptions of test procedures, a history of the Board of 
Examiners, specimens of tests for principals and assistant principals given 
in the last decade, instructions to Examination Assistants, announcements , 
and research reports and test evaluations prepared by the Board of Examiners 
" and research Proposals describing research in progress or research to be ine 
itiated. In addition, I have Served on several occasions as an Examination 
Assistant for the test for Research Technicians participating in the phases 


of item-writing, Paper~scoring and interviewing. I have read sections of 


the emo rand or Infunctive Relief: Chance Mercado v. The Board of 
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‘Examiners and a number of affadavits in support of that brief. On the basis 
of the foregoing I feel prepared to submit the following observations about the 
objectivity, reliability, and validity of the testing procedures of the Board of 


Examiners which I feel are relevant to the matters under consideration, 


I. For the Board of Examiners, concern for objectivity, or freedom 
from bias, emanates not only from an effort to keep its testing procedures 
in accord with the standards of the testing profession, but also from an 
earlier mandate for establishing and maintaining a system of appointments 
and promotions in the schools of the City of New York that would be free 
from the abuses of patronage, corruption, and pressures from any special 
economic, social, ethnic, or political interest. Thus an eléhorete set of 
procedures and safeguards was developed and maintained to protect candidates 
from nas competition, Having studied these procedures, I feel that 
particularly in the written tests, there is little likelihood that errors 
or slippage (should they even occur) would favor, in a systematic or 
biased way, the interests of a single candidate or group. 

Interview tests, . any procedures that involve ongoing 
interactions of other human beings with a candidate, are, by their very 
nature, always somewhat more vulnerable to conscious or unconscious subjective 
responses (or "halo effects") to the candidate or to the groups to which he 
belongs. By randomizing the assignment of interviewers » by always assigning 

-three interviewers to examine a single candidate, by explicitly specifying 
the criteria ond attributes that are to be rated, by clarifying which 
attributes are not to be rated and tho pitfalls of halo effects, by requiring 
interviewers to keep written records and to provide justifications for their 
ratings, by providing Saperecordings of all interview transactions the 
Board of Examiners has scrupulously sought to reduce to the limit the 


on} a 
possibility of bias in tho intorviows. Barring the occurrence of practices 


not known to ne, I feel confident in asserting that the Board of Examiners 
has achieved in its test procedures a level of Ndiginterestedness" that ‘ 
competes in this respect with all screening, testing, and recruiting 
procedures that have been devised and are currently end and certainly 
excels most informally or unprofessionally formated procedures, Within 
the bounds of the criteria that have been established for any test, a 
candidate before the Board of Examiners may expect to be assured of open | 
and fair competition. ; 


II: The reliability, or accuracy with which a test procedure 
measures that which it purports to measure, is an evident matter of con- 
cern for the Board of Examiners. There are a number of technical approaches 
for determining the reliability of a test each of which yields a numerical 
coefficient or index of the degree of reliability of the test. The 
appropriateness of one or another technique, or group of techniques, for 
determining the reliability of a given test will depend on the nature of the 
test and the aspects of the test which might prove to be sources of error 
or unreliability. 

Measures of "internal consistency" are appropriate when a series 
.of items or test procedures are intended to measure a single trait. A study 
reported by the Board which examined the scoring of a test of written English 
revealed very high coefficients of reliability and attested to a conformity 
with high technical standards in test evaluation and test construction. 

When a test is intended to measure more than one trait, skill, 
attribute, or field of knowledge, the possibility of its successfulness 4s 
enhanced when the parts are not correlated with each other (4.e. did not show 


overall internal consistency) while a high level of internal consistency, or 
reliability, is maintained within the parts. Such tests are best when the 
‘several parts are, furthermore, hishly correlated with the total score yielded ' 
by the test. Two studies by the Board revealed total test procedures that 

met these high standards of reliability. One of these studies was an 
Analve9_of Exam’ of Examination for Principal (1965) and is peronenty germane to 
the mater at hand, 


\ study of Int ra- and _Inter-rater Reliability of the ew T. 


conductec to determine which rating forms are most conducive to arriving 


at high reliabilities or internal consistencies among interviewers (but, 
apparently, not conducted in connection with any specific test adminietration) 
reveals that a high level of agreement, or reliability, among interviewers can 
be achieved using the optimum forms the Board seeks to develop while retaining 
a high degree of discrimination, or distinction, among candidates. This 
study attests to the vigorousness with which the Board seeks to perfect its 
test procedures, 

"Repeat" or "test-re-test" reliability indices are designed to 
reveal the durability or consistency of a measure over specified periods of 
time. The Board failed to adduce evidence that its test exhibited this type 
of reliability beyond the usual presumption that test which are internally 
consistent are likely also to be curable. It must be granted that given the 
arduousness of most of the tests administered by the Board and given the 
emall likelihood that candidates could be persuaded to sit for alternative 
forms of the tests on separate occasions when doing so would only serve the 
purposes of a study and not their needs for licensing, that it would be very 
unlikely that a successful study of repeat reliability could be staged. 
Furthermore, it must be granted that inherent in studies of repeat 


reliability is an assumption that the trait measured remains consistent 


1. 


798, 

. — . 
within individuale.. Such an assumption might be a questionable one in respect 
to the traits studied by the Board of Examiners, particularly if one has 
faith in the notion that training and study can change and improve one's 


preparation for a job or a test. 


III. The approach used by the Board of Examiners in determining 
the yolidity or wiiveneset its tests consists essentially of a strategy 
which relies on the judgments of experts and consensus among them as to what 
constitutes an appropriate test item. The level of validity that may be 
achieved in this regard is implicit in the procedures used for developing 
the tests (1.e. starting with a series of job-specifications and assigning 


expert practitioners the task of writing appropriate items) but it is 

limited to the validity of the "best guess" of experts. Without studies 

of predictive validity (i.e. assessments as to how well the test selects 

individuals who function successfully on the job) the very assumptions as 

to what constitutes expertise in any given field cannot bs fully tested. 

(As far as I know, however, licensing examinations for professions s 4 as 

medicine, law, psychology, various social and health services, etc, are not - 
any more widely validated by extensive follow-up studies than the examinations 

used in education. ) 

In the case of the Principals' Examination of the Board of Examiners 
one modest exploratory study of rated on-the-job performance did tend to 
confirm the predictive validity of the test. This study encountered a 
number of methodological snags which would seem to be almost inevitable 
given the complexity of the problem and the complexity of the syetem in which 
it is situated, Fittingly, the researchers interpreted their results 
conservative. y and modestly. Yet an outsider might be permitted to feel 


€rcourned by their results, Other studies of a more profound nature are 
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undorway or aro, at least, fully planned, 

‘The most rocent forms of the Principals! Examination consist mainly 
of items that ore closely tied to specific problems of ochools and apparently 
seck to assess the judgmont and prudence that a seniatinn might ‘exhibit when 
confronted with situations that evidently comprise the daily problems of the 
job. To assume that these .sts can be valid predictors of success in leading 
a school one must also assume (a) that the judgments a candidate makes on a 
written test c> interview are likely to be of the same quality as those he will 
make in a real-life situation; and (b) that the informed opinions in the field 
of school administration are, in fact, well-suited to the etrentes leadership 
of schools, The Board of Examiners evidently finds these assumptions to 
be reasonable and legitimate, 

In the procedures of the Board of Examiners, the definitions of what 
makes a goou school principal are prepared by the Superintendent of Schools. 
The test writers derive "validity criteria" from the job specification. end 
definitions, It seems to me that it is actually with these criteria -~and 
not with the testing— that the plaintiffs in the matter at hand seem to 
have their cavil. As far as Y can tell, the brief seems t> ask for a new 
definition of a school principal. Thus it is a matter that goee beyond the 
desue of testing and licensing examinations. Or it may be seen as a matter 
that precedes examinations, for in order to develop a test, the preparation 
‘of items and procedures mst be preceded by clear validity criteria, 

As a student of language I am particularly interasted in the social, 
and cultural implications of the objections to the tests of written and 
verbal expression. A plea for profound and complex changes in social and 
cultural attitudes is implied by the plea for altering testing in regard to 
the linguistic behavior of educational leaders. A full exploration of thie 
matter is beyond the scope of this document and is probably not germane to the 
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Affidavit of Esin Kaya Carton verified on October 25, 
1970 (attached as Exhibit 2d to Rockowitz 
Affidavit) 


October a7, 1970 


To Whom It iiay Con ern: 


My name is Esin Kaya Carton. I reside at 3 Hunters Court, 
Setauket, New York 11733. I am emp ved as a professor of educational 
: psychology at Hofstra University ano m appointed as the chairman of 
the Department of Educational Psychology. 


I hold a BA degree from Barnard College earned in 1954, MA degree 
from Teachers College, Columbia earned in 1955 and Ph.D from New York 
University earned in 1959 in educational and psychological measurement, I. 
have served on NYU and Hofstra faculties since 1957 and have consulted to 
governmental, public and private organizations always in the capacity of a 
specialist in educational and psychological measurement. I have published 

delivered more than fifteen papers in this area. 
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' The points given below as reactions to the procedures used by 
the Board of Examiners in screening candidates for the positions of 
assistant principal and principal in New York City . a based on two main 
sources of information: (a) a close review of the mserials made available 
by the Board of Examiners and (b) a meeting with the representatives of the 
Board where questions wore answered by them, 


Sound evaluation procedures concern themselves with problems of 
validity or relevance, objectivity or elimination of bias, and reliability 
or accuracy of the results. As I understand the procedural objectives that 
have been ~aised to the Board's testing program, they center around (a) the 
relevance of the testing program to performance on the job; (b) objectivity 
in testing and scoring and (c) the reliability of the test results, 


It is my professional judgment that the Board has attempted to 
deal with all three of these important procedural matter in a professional 
way to the best of its ability. 


On the question of objectivity. The Board has a list of fourteen 
methods used to insure objectivity. In addition to these fourteen methods 
vo insure objectivity, there are further statistical techniques which can be 
used to investigate the degree of objectivity achieved. I have read among 


the materials submitted to me two papers which show the application of such 
techniques, 


On the question of reliability. I have read among the studies con- 
ducted by the Board of Examiners a paper dealing with the internal consistency 
of the written examination and one with inter-rater reliahl lity of the inter- 
view ratings. Both cases represent proper application of reliability techniques 


On the question of relevance. The procedures used to establish the 
validity of tho tests indicate that the items selected for the examination 
represent an attcmpt to simulate the events candidates would encounter on the 
Job. There are cifferent techniques for either assuring or studying the rele- 
vance of the test to the requirements of the job. The technique used by 
the Board, namely estavlishing contont-validity, attempts to assure the 
rolevanee of tha itoms on the test te job critorla established by the 
profosolonala in tho field. Whilo a second tochnique, namoly establishing 
oF the Lest "to gob portance Ait woul arMBLATh SenertaNg He Aalenapee 
essential to Soe opaee hee eo eve of the tes to the critefia of 
performance on the job. 
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Tho purpose of the testing program is to ‘screen some applicants 
on the basis of some prefessicnil criteria specified by the professional edu- 
cators in the field, At tho enc of the testing program, I understand there 
are approximately six times as many canc.dates who pass the examination as 
thore are job openings. If there are any criteria or requirements specific 
to a given lecal position, there is no reason why these additional criteria 
may not be applied locally in the selection of the individual to fill the 
pesition. All that the testing program seems to do is to evaluate the 
ctanding of the applicants on what would be the most universal, minimal 
professional performance criteria which would apply regardless of local — 
differences. 


Generally, it is desirable to use as much information as possible 
about a given applicant in selecting him for an opening. In obtaining such 
information, the most useful group of data consist of pieces of information 
which complement each other, which are independently relevant to the job 
requirements but which do not correlate among themselves. One study, conducted 
by the Board, shows the correlations among the sub-tests to be low, but the 
correlation between each sub-test «nd the final acceptance score to be 
quite high. Similarly, the testin_ program has greater value if it supp)ies 
4nformation on the criteria deemzi minimally desirable for all openings, 
and complements but does not correlate with other possible criteria (such 
as bilingualism) desired in a specific location, 
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UNITED STATES DISTRICT COURT 
SOUTHERN DISTRICT OF NEW YORK 


BOSTON M. CHANCE and LOUIS C. 
MERCADO, et al., .. - 


Plaintiffs, 
: Civ. No. 4141 
-against- Index No. 70 


BOARD OF EXAMINERS, et al., AFFIDAVIT 


Defendants. 


STATE OF NEW YO . 
: CO eas 
COUNTY OF NEWYORK ) 

JAY E. GREENE, being duly sworn, deposes and says: 

1. I am a member of the Board of Examiners of 
the Board of Education of the City of New York, and one , 
of the defendants herein and submit this affidavit in 
opposition to plaintiffs' motion for a ppeltninary 
injunction. : 

2. I have been a member of the Board of Examiners 
since 1950. | Prior to my appointment as an examiner, I was 
employed by the New York City school system as a teacher — 
and supervisor for over 14 years. 

3. Paragraph 20 of plaintiffs’ Amended Complaint _ 
recites various hiat tories indicating that there is a low 
percentage of black and Puerto Rican supervisors in the 
New York City school system. On the basis of the afore- 
said. recitation, Paragraph 21 of the Amended Complaint 
concludes that " The Board of Examiners procedures are 


the major factor accounting for. this low percentage in 


88a 
‘minority group personnel. " Assuming,- for the ‘sake of 
argument, that the plaintirts: statistics are accurate, 
its conclusion, in Paragraph 21, is absurd and totally 
unsupported or unsupportable by any facts. The Court 
must understand that the Board of Examiners does not 
determine the eligibility requirements for applicants for 
supervisory positions. Those are determined by the State 
Education caper teers and the Board of Education through 
the Chancellor. Thus, it is obvious that the number of 
black or Puerto Rican applicants cannot be a function of 


the Board of Examiners'- procedures. The Board examines 


iene 


only. those who are eligible under requirements set by the 
| Board of Education. If few blacks are eligible, obviously, 
the number of blacks who are licensed will be small. : 
Clearly, the Board of Examiners has no control over the 
number of black and Puerto Rican applicants. Accordingly, 
the recitation of statistics concerning the percentage of 
blacks and Puerto Ricans among the total number of licensed 
Supervisors, is irrelevant to these proceedings. 
4, If statistics have any relevancy in deter- 
mining the claim of discrimination, the only Mpegs abcde 
statistic would be a comparison of the Pere ree’ ratio 
of black and Puerto Rican applicants. 

o.. Ff such an evaluation ‘were undertaken, it 
would demonstrate clearly that eligible black or Puerto 
Rican applicants have performed comparably with white 

4 


applicants on examinations. Thus, in the:1964 examination 


= 


a 40% ratio passing as compared with approximately 25% of 
| 


‘a total of 46, and the list is believed to have placed 


‘candidates, 20% or 140 successful candidates were black 


89a 


for elementary principal, “at is believed that. approxinately 
7 black ‘and Puerto Rican indiyiduals applied, of whom we 
are informed 5 achieved a place on the list. In the 1964 
examination for principal of @ junior high school, it is 
believed that:5 black and Puerto Ricans applied, of whom 
two were placed on the list. In the 1968 examination for 
principal of a day high school, it is believed that only 
5 applied of whom 2 passed all parts of the examination. 
(One of these two eoeesd to be ineligible after passing all 


parts of the examination. ) In this examination there was 


whites. In the examination for assistant to director of 
libraries, there were 19 applicants of whom it is believed 
4 were blacks or Puerto Ricans and the list had 2 blacks or 
Puerto Ricans out of 4 successful candidates on the list. 
In the 1964 examination for supervisor of C.R.M.D. (Chil- 
dren with Retarded Mental Development) it has been es- 


timated that there were 7 blacks and Puerto Ricans among 


5 blacks and Puerto Ricans out of a tutal of 18 candidates 
on the list. In the 1964 examination for assistant. to 
principal in elementary schools, the first supervisory 
examination in which a substantial number of black and 
Puerto Rican “indtviduais, applied, the results were, accord- 
-ing toa study by the Human Relations Unit of the Board 


“of Education, that out of a list of about 700 successful 
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or Puerto Rican. (start Bulletin, Jan. 10, 1966, ~~ 
hereto as Exhibit ] ). In the summer of 1970, a ‘@osed 
examination was given to 7 black applicants and one Puerto. 
Rican for the. principalship of ‘high school and igen 
high school. Five of the eight (including the Puerto 
Rican) were successful, and one is still under considera- 
tion. The same type of scope and job-related examination 
was used in this examination as in prior. promotion examina- 
tions. The number of atnority group seabers listed was 
larger because larger numbers filed. | 

6. The small number of eligible black and Puerto 
Rican applicants can readily be explained by an understand- 
ing of the sources from which such applicants are derived. 
In any given year, the numbers of teachers in the New York 


City schoul system who are graduates of the City University 


of New York will run from 55 to 70% of the total. Since 
the City University supplies the great bulk of New York 
City's teachers, it is quite relevant to look at the 
ethnic composition of their student bodies in recent years. 
A recent report by the City University shows the following 
student body distribution: 
(1967) (1968) _1969 
White... .'. 7¢ 87.08) (85.68) 80.28 
Maer... c5- cst BO (1a on 
Puerto Rican . . ..€ 1.98) ( 2.3%) 3.0% 
Other... ss sh 3) CRD) OS 
No Response... .(_ __.8%) (1.88) 3.1% 
TOTAL. . . . . .( 99.9%) * (99.9%) 100.0% 
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‘Report of the Fall 1969 Undergraduate Ethnic a 
Census, The City University of New York, 
Office of the Vice-Chancellor for the 

’ Executive Office, December, 1969, attached 

' hereto.as Exhibit 2 ). 


7; Obviously, ell of the graduates of City 
| University are not entering the teaching profession so that 
the percentage of black and Puerto Rican graduates available 
to become applicants for teaching positions is considerably 
smaller. Thus, it ‘4s clear ‘that the small number of teach- 
ing and supervisory positions held by blacks and Puerto 
Ricans in the past has had nothing to do with the activities 
of the Board of Examiners. | | 

8. Far from demonstrating a pattern of dis- 
crimination, the statistics presented by the plaintiffs 
(Table II) demonstrate that the number of black and Puerto 
Rican supervisors is rapidly increasing. For example, in 
1963, the plaintiffs allege there was only one black or 
Puerto Rican principal and in 1970 there were 12 black or 
Puerto Rican principals. Even more dramatic is the assist- 
“ant principal category where, in 1963, there were 11 black 
or Puerto Rican assistant principals and in 1970 there are 
119. It is fair to assume that a substantial portion of 
this 119 are applicants for the current elementary school 
principal's examination, which this action seeks to enjoin. 

One additional factor tending to keep the . 

"percentage of black and Puerto Rican principals in New York 


City lower than that in some other cities is the fact that 
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the eligibility requirements for ‘such positions in New York 


City have been higher than in other cities. “In the past, 
eligibility requirements for principalship in New York std 
have ‘involved 10 to 15 years of teaching experience, in- ° 
cluding experience on an intermediate supervisory level. 

We are informed that, in the other cities, intermediate 
supervisory experience has not been required and 3 to 6 
years of teaching experience was required. Eligibility 
requirements are not set by the Board of Examiners. How- 
ever, recently revised eligibility requirements in New York 
City now make it possible for hundreds of blacks and Puerto 
Ricans to apply. Moreover, the list will be an "open- 
qualifying" one, and communities will be. able to choose any 
person from the list so that the number of licensed prin- 
cipals of black and Puerto Rican background in service is 
likely to. increase dramatically: in the near future. 

9. Contrary to the plaintiffs' contention that 
the Board of Examiners has participated in @ program of 
discrimination against blacks and Puerto Ricans, it is a 
fact that it was at the suggestion of the Board of Examiner 
that the Board of Education instituted professional prepd- 
rational seminars to guide applicants in their preparation 
for examinations. Such special seminars are in operation 
and are located in geographical areas heavily populated 
by blacks and Puerto Rigans. Currently, there are 346 
blacks and Puerto Ricans in: tnese seminars and it has been 


estimated that the great bulk of these have filed for the 
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November 3rd examination for principal as compared with 
approximately 7 such applicants in the previous examina- 
tio: Certainly, such efforts belic the plaintiffs' 
contention that such applicants "are untutored in the 
esoterics of test-taking in the New York City school 
system,"'(Plaintiffs' Amended Complaint, paragraph 2) 
and "have not had equal access with whites to esoteric 
knowledge of the bureaucracy." (Plaintiffs' Memorandum, 
page 6.) 

10. Far from the negative view expressed by the 
plaintiffs' Amended Complaint and Brief that blacks and 
Puerto Ricans are Systematically being excluded from the 


New York City school System, the facts reveal positive gain 


in accelerating the rate of entry of blacks and Puerto Ricans 


into the teaching profession. It is estimated that, whereag, 


there were perhaps 1,500 black and Puerto Rican teachers in 


1963, there are about 6,000 at the present time. Moreover, 


y, i substantial numbers are applying now, whereas few applied 
in the past. In addition, the U.F.T. and the Board of ) 
Education, assisted by the Board of Examiners, as of thia, 
fall, are beginning a recruitment effort for the major 
purpose of adding hundreds of blacks and Puerto Ricans 
to the staff. In.New York City schools there are 
approximately 20,000 para-professionals, the vast majority 
of whom are black and Puerto Rican. A career ladder is 


being developeu to give many of these an Opportunity to 


advance to teaching positions. 2 Fi 
ho oo 
Pie dies . KO WEL / 
C7 JAY E. GREENE ~ 
‘ SWORN to before me this 
A MAY M. CURRAN 
AG aay of October, 1970. Commilss'oner of Ocacs, City of tow York 
Kings County Clack + Mo. 2-551 
ve Litt . Commission Expisea june 24, 197] 


No ry Pubiio, -7- 
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Affidavit of Murry Bergtraum verified on 
October 26, 1970 


' U.S. c. §1344 (3), is for: injunctive and declaratory relie:. 


‘says: ; : 
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IN THe UNITED STATES DISTRICT COURT 
YOR THE SOUTHERN DISTRICY OF NEW YORK 


BOSTON M.: CHANCE and ee C. MERCADO, 
et al.,. 70 Civ. 4242 


Plaintiffs, AFFIDAVIT 
against 


BOARD OF EXAMINERS, et al. 


Defendants. 


STATE OF NEW YORK 
COUNTY OF? NEW YORK ) 


MURRY BERGTRAUM, being duly sworn, d*poses and 
: | 


1. ZI am President of the Board of Education of 
the City of New York, one of the defendants herein, and I 
submit chis affidavit in opposition to plaintiffs' motion 


for a preliminary injunction, 


2. The instant, action, brought wader 42 U.S.C. 
§§1961 and 4983 and: neds Jurisdictional implementatio.., 78 


The two nace’ plaintiifs are acting principals of elementary 


echools in New York City and’ holders of New lark State 


: principal's certificates. They do net hold a New York City 


4¢cense as elementary school principal which is Heveacary to 
obtain &n appointment .in the New York City school system, ., 
It is alleged in the complaint that one of the Plaintiffs 
ds Black and the other is Puerto Rican and it is further © 
wiisad that they bring this action on their own behalf and | 


as &@ class action pursuant to Rule 23, F.R.~ 


| 
| 


3. It te alleged that tho defendant Board of bx- 
anlners will hold an ‘examination for elementary school prin- 
cipal during the Autumn of 1970 and will promulgate an cli- 
Bible list in the Spring of 1972 based on such examination 2 
(Complaint, par. 12), 


4, Plaintiffs! claim that there is a low percen= 
tare of meray Groups in New York City School System an 
ae in Bupervasory capacities and that this is due toa ‘the 
Costing presedures employed by the Board of Examiners. AY-_ 

legedly, these procedures are biased against Blacks and 


Puerto Ricans. (Complaint, pars. 13. 18 and, 15). 


5. Plaintiffs further allege that’ the examination 


procedures employed by the defendant Board of Examiners are 


in violation of the United States Constitution and the Con- 
stitution and laws of the: State of New York. I¢ is further 
Claimed that the Board of Education in violation of State 
Law ‘as, in the past, left, and plans to leave, to the Bo 

of Examiners exclusive discretion in the preparation, admin~ 
istration and grading of the forthcoming examination pro~ 


cedure for elementary school principal. 


6. Plaintiffs request: this Court | to declare the 
present and planned examination procedures employed by the 
Board of Examiners to be unconstitutional, They seek to 
‘enjoin the defendants from usioag any exani nation for phineips 
which has not been prepared in accordance with academic and 


professional standards established by the Board of Edueation. 


7. Incident to this actica is the present motion 


brought pursuant to Rule 65 FRCP seeking to preliminarily - 


enjoin the defendants from: 


‘Administering or otherwise making use — 
of any written and/or oral test, as a’ 
‘-eriterion for the New York City Licones 
of elementary 8Ohool principal or for’ “any 
other New York City public school syotein 
supervisory license, which has not been 
prepared and validated in accordance with 
the latest standards of professional psycho: 
logical testing as eeeneareye measuring, the. 
merit and fitness of candidates se perform: 
the tasks of the position for’ wnsen the 
test is being administered; and fron 
administering or otherwise making use of 
an examination for principal which has not | 
been prepared in accordance with, which doe} 
not strictly adhere to, and which in no way: 
exceeds specific. academic and professional 
standards for the license of principal 
established by the Board of Education pur 
‘suant to §2573 (10) of the New York Educa- 
tion Law, and for such other relief.as the 


Court may deem just and Proper, 


* 


. a The dears opposes plaintiffs, motion ue pre- 
liminary injunction because as ee ect forth the 

_ Granting of the interim relief sought would be ateruptive . 
to the entire 8chool system of the City of New York, 8 


9. ‘The written portion of the examination for. 
CreReTEATY, school principal is Bcheduled for November 3, 
1970. The eligibility requirements, the scope of the 


examination and other relevant data ies uel ok the examin- 


ation are set forth in an Examination Aanouncement, dated 
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i 
| September: 11, 1970, a copy of which is annexed and marked’ 
Exhibit "A". It is the announced intention of the Board of 
Examiners and the office of Teacher Personnel of the. Board . 
of Education to conduct written, oral and medical tests in. 
this oxcinination at a site in Puerto Rico, as’ well as in 
New York City. This examination was announced on September 
ai, 1970. It was requested by the then Acting Superintendent 
of Schools, Mr. Irving Anker, it tne recommendation that: 


the examination be completed, if possible by February i, 
1971, or at the latest in the Spring of 1971. 


10. In wauinek: to the elementary: school principal 
examination, many other supervisory exantiations have been 
conducted, are being conducted, and are projected by the 
Board of Examiners. A report on the status of these examin- 


ations is annexed and marked Exhibit "Bp", 


li. tr plaintarfs' motion for a preliminary injunec 


tiny is ero then all.of these examinations will be dis- 
rupted. This result would be highly injurious 4 the New 
York City school system and the children avbensine its : 
schools. It would deprive those schools of primary and 
intermediate leadership in Supervision, in administration,’ 
curriculum direction, and relationship with pavente and 
the community. Plaintiffs Suggest that persons could be 
‘ seadened in acting capacities to fill the void. However, 
it 18 self evident that an rs principal or other acting 
supervisor ss not in @ position to act with the continuity, 
authority and assurance attendant upon appointment to a 
position and the resulting tmure in office. The necessity 
‘to have fvlly. tenured supervisors at all levels is reinforcad 


by the extrem difficulties face by our schools, school 
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‘ 


boards, students, parents, teachers and administrators in 
this transition period from a centralised school systcm:to 
a decentralized one. ly 
12. Asa result of the liberalized ‘pension benefits 

Granted by the New York State Legislature in '1969 it is anti 
cipated that more than 50% of the present supervisory staff 
will retire within the next four ycars with the bulk retir- 
Ang within the next year or two. This is the reason for | 
the request of the Acting Superintendent of Schools that 

the promigsiion of a list.of principals in day elehentary 
echools be <*!octed not later than the Spring of 1971. It 
would be 4n unnecessary hardship on the syeten to postpone’ 
the anncunced examination as well as other supervisory exam~ 
inations when th? need is so pressing now and will become 


i much more acute within a short time. a 


oe 
13. The Board of Education's opposition to the, 
Plaintiffs' motion for a preliminary dojunstion is not 
based upon an ehabeakion of the merits of plaintiffs' overal 
case. The Board ts ae the opinion that the complaint raises 
issues of fact which should be determined at atrial. The 
Board's position is that the sole statutory responsibility 
for the administration of tests for supervisory pevainnad 


‘liege with the Board of Examiners. 


14. New York Education Law §2569 provides in. 
pertinent part: : 


| - "It'shall be the duty of the| board 

{of examiners) to hold examinations 
ie whenever necessary, to examine! all 
: applicants who ere required to! be 

licensed ... Ti« borrd fof examiners ) 
shall periodicaily weview the validity 

eas - and reliability of examinations as well 

‘ 88 eXaninatien ~socedures." _ | 


! 
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| 15. Since Education Law §2569 devolves the 

| duty upon’ the Board of Examiners to administer all license. 

examinations it is tho positién of the Board of Education 
that the Board of Examiners should satisfy the burden of 


defending their examination procedures. 


16. In cohelusion, in view of the 7-98 diss 
ruption to the New York City School System which would be 
caused by the granting of the preliminary reiicf plaintiffs 


seck, it is- respectfully requested that their motic. for a. 


preliminary injunction be denied in-all respects. 


Sworn to before me this 


“btn day of October,- 1970. ON Satay GERC Tp deg 
DANTE WW. KINGSTON HURRY BERGTRAUM 


Pweg: Vubie, State of How Yor! 
Wo. 41-7:'73100 Qualified in Queens County 
Cortlic ate ed in thew Youk County 
Commission _— Merch 30, 1972 | 


. 
i Ho nner meen sds eins 


. 
Na er Ree sea i etemenesentett ation sine 


cro ee etna eeeenenenneetaenee 


Temporary Restraining Order filed on 
November 4, 1970 
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UNITED STATES DISTRICT COURT — 
SOUTHERN DISTRICT OF NEW YORK 


BOSTON M. CHANCE and LOUIS C. MERCADO, : 
etal., CIVIL ACTION 
i 70 Civ. 4141 
Plaintiffs 


CQUNTER PROPOSED 
against ORDER FOR TEMPORARY 
! RESTRAINING ORDER 
THE BOARD OF EXAMINERS, etal. 


Defendants. 


for a preliminary injunction, and the Court has decided to 
take the matter under advisement and to defer its ruling 
thereon. It appearing to the Court from the complaint, the 
amended complaint, the affidavits, exhibits and memoranda 
heretofore filed in support of the motion and in opposition 
thereto, and the oral argument heard on Octover 27 and 29, 
that pending the determination of this motion the defendant 
may commit certain acts resulting in a change of the status 
quo, it is \ 

ORDERED that pending the determination of this 
motion, the defendants are henceforth restrained from prom- 
ulgating or otherwise publishing any new eligible lists for 
supervisory service positions in the New York City school 
system, provided, however, that this order shall not restra 
the ddntribatration of examinations for supervisory service 
positions nor is it applicable to any eligible lists for 
supervisory service positions promulgated prior to October 
29, 1970, or restrain the eppointment of supervisory servic 
- personnel therefrom. 


- Dated: New York, New York 
November ‘t 1970 


4 Wale ck, Man ict 4 


.This cause came On to be heard on plaintiffs’ : 
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AFFIDAVITS IN SUPPORT OF MOTION 
SUBMITTED ON NOVEMBER 6, 1970 
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Affidavit of Peter J. Strauss verified on 
November 4, 1970 
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UNITED STATES DISTRICT CoUu:T 
SOUTHERN DISTRICT OF NEW YORK 
serene an TL EO Oe me ee SS Oe OY OO OD Oe an et ew oe ae oe Hf 
HOSTON M, CHANCE and LUIS C, MERCADO, 
et al., 
Civ. No. 4141 
Plaintiffs, Index No. 70 
AFFIDAVIT IN SUPPOR'T 
OF MOTION FOR 


PRELIMINARY INJUCTION | 


-ogainst- 
KOARD OF EXAMINEKS, et al., 


Defendants. 


STATE OF NEW YORK ) .. 
COUNTY OF NEW YoRK ) 55-3 


MM ce ee om ef cf we oe 08 of oe 


PETER J. STRAUSS, being duly sworn, rleposes and says: 

1. I am an attorney-at-law and partner in the firm 
of Moldover Hauser & Strauss at 110 Mast 42nd Street, New York, 
New York. I am presently Chairman Pro-tem of Conmunity Echool 
Board #2 in Manhattan. I submitted an affidavit previcusly in 
support of plaintiff£s' motion for preliminary injuction in tiie 
above-captioned case, I have read the affidavit of Murray 
Kockowitz, dated October 26, 1970, submitted in opposition to 
aid motion. I am submitting this affidavit in reply to 
ir. Rockowitz and in further support of plaintiff's motion for 
prelisinery injunction, 

2. In paragraph 11 of Mr. Rockowit>.! affidavit, he 
states that the soard of Examiners assembles committecs of 
experts and lay persons to help select the mest significant 
duties and qualities being tested for and to devise test ques- 
tions relevant to the job at issue. He cites as on example of 
this process a meeting that took place December 12, 1969, whici, 

‘he notes that I attended, to consider the exswination for 


Principal, Day Elem:ntary School (the writte: portion of which 


is scheduled for November 3, 1970). 
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3. I did in fact: attend this meeting. It lasted 


approximately two hours. So far as I know it was the only 
meeting of outside experts and lay persons assembled for the 
purpose of considering the Elementary School Principals' Examina- 
tion at issue. Indeed, I know of no other such meet:ing in connec 
tion with aes: susebvinies examination. 

4. This meeting was not called for the purpose of 
obtaining the views of the consultants "on the qualities being 
cested for" (Paragraph 11 of Mr. Rockowitz' affidavit) in the 
proposed exam or to discuss appropriate selection criteria. 
Rather, the invitation to eecead the mecting requested our 

and techniques. 
views on the examination format/ (See attached Exhibit 1, letter 
of invitation to the meeting from Marvin Weingart, head of 
Unit 5, Board of Examiners.) During the course of the meeting 
it became apparent to several of us who participated in the 
meeting (listed in paragraph 11 of Mr. Rockowitz' effidavit) 
chat it was impossible to consider the appropriateness o1 testing 
techniques and questions without considering the qualities to be 
tested for. It is my recollection of the meeting that the 
ensuing discussion of the qualities to be sought in a candidate 
was initiated by the consultants, not by Mr. Rockowitz or any 
other representative of the Board of Examiners. Many of us 
expressed our dissatisfaction with the adequacy and relevance of | 


| 
the qualities which the Puard of Examiners was apparently intend-| 


ing to test for, based on the established "duties of the posi- | 
‘ 
tion.’ We indicated that: in our view it was essential to tcet 


for qualities which traditionally have never been considered by 
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the Board of Examiners in examining principals. 


5. The meeting concluded without any sort of consensus 
or agreement having been reached between the consultants present 
at the meeting and the members of the Board of Examiners and | 
their assistants present. There was never any follow-up to the | 
meeting. 

6. To my knowledge, the "duties of the position" pre- 


viously established were in no way varied or modified as a result 


of the meeting. On August 28, 1969 the Beard of Examiners issued 
an announcement for an examination for the position of Principal, 
Day Elementary School. Said announcement included a listing of 
the "duties of the position." A copy of said announcement is 
attached hereto as Exhibit 2. On September 11, 1970 as part of 
the announcement by the Board of Examiners of the examination 

for the position o. cincipal, Day Elementary School, to be held 
on November 3, 1970 (the examination in regard to which I had 
been invited to discuss at the meeting on December 12, 1969) the 
Board of Examiners issued another list of the "duties of the 
position". A copy of said announcement is attached hereto as 
Exhibit 3, 

A comparison of the two lists of "duties of the posi-~ 
tion" reveals that they are virtually identical. It would 
appear, therefore, that the meeting which I attended on Decem- 
ber 12, 1969 had no effect whatsoever i planning for the 
November 3, 1970 examination, / 

| 


! 
a ee. 


PETER J. STRAUSS 
Sworn to before me this 
4th day of November, 1970. 


‘f A yode) A a Clu.ekr 


OWARD D, MOLDOVER eee 


Aitomey wl Ct . 2 
Bi to of Hew York feo. ‘] 2iit". 


Aad 
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Affidavit of Richard S. Barrett verified on 
November 5, 1970 


107a 


UNITED STATES DISTRICT. COURT 
SOUTHERN DISTRICT OF NEW YORK 


—— = we or hlellUrhl lll lll rll 


: : 
BOSTON M. CHANCE an¢l LOUIS C. MERCADO, 
individually and on behalf of all g 
others similarly situated, 
' t 
Plaintiffs, CIVIL ACTION 


v. 70 Civ. 4141 
THE BOARD OF EXAMINERS, et al., 


Defendante. 


— =< = = oe eo cw S88 coo ef a 


AFFILSVIT IN SUPPORT OF MOTION 
FOR PRELIMINARY INSGUNCTION 


RICHARD S. BARRETT, being duly sworn, deposes and says: 


a. My ao Richard S. Barrett, and I submit this 
affidavit in support of plaintiffs' motion for preliminary 
injunetion. Svbsequent to my affidavit of October 15, 1970, 
have examined an affidavit of Murray Rockowitz dated October 
1970, together with its attached Exhibits 1, la, li. 2a, 2b, 
2d, 3, 4a, 4b, 4c, 5, submitted in opposition to plaintiffs’ 
motion for preliminary injunction. I base my comments on them. 
The selection of documents is more notable for what is omitted 
than for what is included. They raise abundant doubts and 
quenti cnn that could have been answared by: the submission of 
related documents that were not prerented. Thus Exhibit 4c, 
which contains very brief summaries of research results is 
particularly inadequate; no judgment about the studies reported 
therein can be made without extensive information about the 


methods employed. The average report fills ‘.ess than half of 
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a page. Only two of these studies even purport to go to the 


essential. question of validity. One of these ("Analysis of 


Examination for Prirncipal-Academic High School-Nov., 1965") 
is not truly a waliatey study since it reports only interrelation 
ships among scores (see 95c below). The other ("Analysis of 
Examination for Principal of Elementary Schools"), which is 
reported in only five lines of type, gives no information on 
methodology, data analysis, or statistical significance of 
results. Without access to the more complete papers, it is 
impossible to comment on the adequacy of the work, the accuracy 
of the conclusions or, indeed, whether the studies have any 
significance for this case. The value of the following analysis 
is therefore limited by the inadequacy of the documentation, but 
the inadequacy of the documentation speaks for itself. 

2. The development of a selection procedure begins with a 
description of the duties of the incumbent, and how and why 
the work is performed. Generally the job description mus* be 
specially done for the selection program because job descriptions 
done for other purposes are rarely adequate. Exhibit 3 to 
Rockowi‘z' Affidavit, Duties of the Position princi al of a. 
Day Elementary School), illustrates the point. Useful as the 
description may be for delineating or fixing responsibility, it 
gi 2s few clues to how the work is done, what performance is 
likely to be successful, or what qualities of a candifate lead 
to success. Certainly, “To organize and administer a modern 
audio-visual program" is part of the job, but what does cne do to| 
achieve the objective? How important is it compared to other 


auties?, 


109a 


It is also important "To work to build and maintain high 
teacher morale," but there are countless unspecified acts of 
principals that further or frustrate this goal, yet no clues 
are given in the descripti.on. 

A dound selection program requires a detailed analysis 
of the position in terms that are relevant to the selection 
process. The job description included in the exhibits is 
inadequate for developing a selection procedure. 

3. Exhibit la to Rockowitz' affidavit, Directions for 

a dar swers and Rating Directions, prescribes 
in part "First, give the matter of the appropriate answer some 
thowsht and study. Consult authorities. Then read through a 
representative sample of answers .. . Draw up a tentetive 
standard answer (with rating directions), bearing in mind the 
applicability of your standards to the answers. used 4 

The scoring key is thus derived from the answers of the 
candidates. If he person who framed the question prepared 
a statement of the answers he considered correct, it is not 


considered here. Neither is there any attempt required in the 


Directions to determine wl eather a given answer is more charac- 


teristic of the better principals than of the less effective 
principals. . 

The effect of this procedure is to perpetuate the conven- 
tional wisdom not only of the examiners but also, more signifi- 
cantly, of the candidates themselves, since the scoring key is 
derived in large measure from their answers. A more sound 
procedure for develeping a scoring key would be to determine, 
or at jeast consider, the job behavior of the more and less 


successful principals. 
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4. Exhibit lb to Rockowitz' affidavit, Guidelines for the 


Use of the Interview Test Rating Sheet, presents 21 scales on 


which the performance of the candidate is to be evaluated. Four 


scales come under the heading "Speech, " eight under “oral 
Discussion," four under "Intcrpersonal Relationships," and five 
under “Other Traits of Personality." Experts in test constructidn 
have found that it has genesis proved difficult to make so i 
many independent discriminations about interviewees; stietaticar 
analysis typically shows that scales such as "Comprehension of 
Problems" and “Comprehensiveness of Treatment of Problems" 
measure much the same thing. No analysis is presented to show 
how reliable or how interrelated the ratings are, nor which, 
if any, predict later success. It is therefore difficult to 
evaluate the procedure. It should be noted, however, that 
nowhere does the scale ask the overwhelming question. "How good 
a principal will this candidate be if he is placed ‘1n the 
position?" 

5. Reference is made in this case to the concepts of 
validity, reliability, and objectivity. Some explication 
of these concepts is in order since there are inconsistencies 
and inaccuracies in the use of the terms by the experts of the 
Board of Examiners. 


5a. Objectivity is used in two different senses. in their 
affidavits. The first has to do with the notion that the test 
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scores are not influenced by the sco.‘er's knowledge of extraneou: 


characterisitics of the candadate, e.g. race, ethnic origin, or 
previous history. Accepting information gleaned from these 
exhibits at face valuc, it appears that, where possible, the 


| 
| 
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Roard of Examiners takesthe routine precautions. 
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The second sense in which the term is used requires that, 
for objectivity to obtain, adequate steps be taken to remove 
from the scoring procedure the personal predilections of the 
scorer. This can best be done by giving him a scoring key based 
on research that shows that some answers are better thon oie 
i.e. that they are characteristic of better performers. The j 
procedure outlined in Exhibit la, Directions for Formulating 
Standard Anewerey hating Directions, encourages the expression 


of one's own »ias_s. 


5b. Reliability is a measure of consistency. It is a 
necessary but not sufficient conditicn for acceptability of 
tests. A test or any other measure is reliable if independent 


measures of the same phenomenon tend to agree. Since no data 


are submitted on the reliability of the tests or interviews, it 


| 
is noc possible to tell if the reliabilities are eatisfactcry. . | 

5c. Validity is classified into "sriterion related | 
validity" and "content validity" in Standards for Fiucationral | 
and Psychological Test.s_ and Measures, American Psychological 


Assn. 1966 (a third type of validity, “construct validity," is 


not relevant to the discussion). The EEOC Guidelines and OFCC 


ay 


Test Order emphasize criterion related validity. Content validity 
: ' 
is accepted when the determination of criterion related Vousniaed 


de not technically feasible. According to the Standards, ! 


“ordtorion related validity io domonstrated by comparing test 
scores with one or more external variables considzred to provide 


a direct measure of the ch7racteristic or behavior in question. *| 


A test has criterion related validity in this context to the 


ed 


extent what high scorers do better on the job. Except for one 


e 


reference to a study of criterion related vaiidity, ee 
j 


*~ 


by one of the defendant's experts as "modest, * “exploratory, 


and “encountering a number of methodological snags," no resort 


is made in the exhibits on criterion related validity. 

The importance of the omission cannot be overst-tri. In 
the last analysis the only justification for the superv’ cory 
examination .ystem is that through its use substantially hetter 
supervisors are selected than would be selected if their nenes 
were drawn from a hat. 

(The statement in Exhibit 2b, an affidavit by Dr. Marvin 
Sontag, that “the decision to de-emphasize predictive validity 
was a wise one" because “It would take 20 «urs to collect an 
adequate sample of appointees for most licentec," and for other 
reasons, is wenteatane by the whole litere: wre of selection 
research. On the contrary, with, for exa~pie, 760 elementary 
school ,vincipals, the Board of Examiners ‘s in an unusually j (+ 


favorable position to conduct meaningful research. ) 


4 


The experts of the Board of Examiners redy . cavily on cortete he 
validity. Prof. Thorndike, ir is affida it, captures the 
essence of the concept when he says, “Proficiency testa .. . | ba 


vl 
must be valuated in terms of te «xtent to which the aspects 


—— 


of knowledge and skill calle@ for by the tests do in fact match 
aspects of knowledge and skill called for in the job for which . 
they were designed." 

Content validity can be determined only after a careful 
study. First, the job duties must be describeé in detail, with 
emphasis on the significant job behavior expected of the r 
incumbent. Second, experts familiar wiih the job and with 
measurdment identify some tasks as being important samples of 


the job behavior. Prof. Thorndike provides an example when he 
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‘lisa 
writes, “Thus, a typing teet in which a typist was called upon 


to transcribe a dictated letter from a tape accurately and with 


correct spelling and correct placement on the page would be 


classified as a proficiency test for a typist." Third, @ means 


of observing, recording, and evaluating the performance is 
developed and examiners trained to use it. Fourth, the test is 
tried out on a sample to make sure that the task and observation 


scheme are reasonable, that evaluations are not unduly harsh or 


easy, and that independent observers achieve substantially the 
game results and other statistical standards are met. It is not 
sufficient to establish content validity to have outside experts 
compare test questions with a one or two page job description. 
A field visit, in which the prospective principal is 


sii, 


observed performing some of the duties of a principal would be 
content valid if the activities in the period observed were 
representative of the activities of a principal, if the observa-~ 
tions were eoulatty performed and if the report reflected his | 


performance on significant aspects of the principal's duties. 


The claim of content validity for essay examinations about 


hypothetical situations would be only partially supported by 


demonstrating that the problem situation seems relevant to the 
job, and that the written answer is in line with the thought of 
qualified authorities. What remains to be seen is whether there 
is a correspondence between one's description of what he thinks 
should be done and what he actually does, or would do under the 
circumstances. It is well known that the columnists who give | 
advice on investments are rarely millionaires. The case of the : 
Board of Examiners would be immeasurab.y strengthened if they 
could ‘on a correspondence between the written answers given 


on examinations and actual performance on the job. In the | 
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written test (or the interview) is not substantiated. 

On the other hand, multiple choice tests of mathematics, 
grammer, current events, cultural knowledge and the like such 
as have been used in the past cannot be justified on the claim 
that they are content valid. They require criterion related 
validity. since they are obviously not intended to be job 
samples. The affidavit of Mr. Rockowitz seems to concede this, 
for the affidavit and supporting papers speak primarily to 


essay questions, and do not even claim content validity for 


absence of such evidence, the claim for content: validity of the 
the short answer questions. 

{ 
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EQUAL EMPLOYMENT OPPORTUNITY COMMISSION 
WASHINGTON, 1.C. 20506 


November 4, 1970 


iM REALLY NEPCR TO 


Mrs. Elizabeth B. DuRois 

NAACP Legal Defense and 
Fducational Fund, Inc. 

Suite 2030 

10 Columbus Cirele 

New York, New York 10019 


Dear Mrs. DuBois: 


My name is William H. Enneis. I live at. 2810 Adams 
Mill Road, WN. W., Washington, D. C. 20009. 


I am employed as Staff Psychologist in the Office of 
Research at the U. S. Equal Employment Opportunity Comnis- 
sion, Washington, D. C. 20506. I have-held this position 
Since 1966 and have both extensive and intensive knowledge 
of minority employment problems ‘created by employment tests 
and other personnel screening and evaluation procedures, 
such as interviews and examinations +dministered to assess 
eligibility for promotion to higher level jobs. [I have 
written numerous papers and articles in the area of testing 
and minority employment. 


I earned a doctorate (Ph.D.) in psychology, with in- 
dustrial specialization, from Pennsylvania State University. 
I have done personnel measurement research for the U. S. 
Air Force ané¢ the U. S. Navy: and I taught courses in in- 
dustrial psychology, personnel selection, interviewing, and 
test construc:tion and validation at the University of 
Georgia for ‘iour years. I am current!y a member of the 


1l6a 


Mrs. Elizabeth B, DuBois Page two 


U. S. Department of Labor Advisory Committee on United 
States Training and Employment Service Tests, and I em 
also a consu).tant on a nation-wide test validation pro- 
gram funded by the Urban Maso Transportation Administra- 
tion, U. S. Department of Transportation, 


The opinions that I express in this letter are my 
own and do not necessrily roflect those of the Equal 
Employment Opportunit: ©“ommission or the U. S. Government. 


tT have read the sworn statements of Richard S. 
Barrett, Aaron Suss Carton, Esin Kaya Carton, Murray 
Rockowitz, Marvin Sontag, and Robert L. Thorndike in the © 
case of Boston M. Chance & Luis C. Mercado, et al. v. 
Board of Examiners, et al. concerning the use of written 
and oral examinations in screening candidates for the 
positions of assistant principal and principal in the 
school system of New York City. 


My comments are listed below. 


1. Apparently, the Board of Examiners base their 
rationale for the use of these qualification 
tests on the idea that the tests have content 
validity. It is also equally apparent to me 
that no studies have been conducted to show 

he relationship between these qualifying 
examinations and actual performance of duties 
as assistant principal or principal, although 
it is highly desirable and certainly within 
the realr »2f feasibility to conduct predic- 
tive valid:ty studies of this nature. The 
establishment of content validity for a test 
may be an admirable first step, but it should 
not be viewed as a substitute for predictive 
validation when the predictive approach is 
feasible. 


117a 


Mrs. Elizabeth B. DuBois Page three 


2. 


The claim of content validity of any test 
designed to assess candidates’ qualifica- 
tions for a certain type of work must be 
supported by carefully conducted job anal- 
yses on both the frequency and importance 
of duties associated with the positions 
for which the tests are administered. 
These dctailed job analyses are required 
so that oxamination itoms can bo preparod 
which proportionally reflect both the fre= 
quency and importance of the job duties. 
Tie job analyses should be conducted by 
independent persons trained in this ac- 
tivity (*ob analysis); otherwise, the re- 
sults m/ be seriously biased by self- 
repoyvts (.,uestionnaires) which are com- 
pieted by rhe incumbents (assistant prin- 
cipals ani principals). The reason for 
this potential bias is that many employ- 
ees in adminisv_rative positions tend to 
report as important those work aspects 
which.they most enjoy or those which they 
do well. Aisa, the {requency of reported 
job functions may be influenced by che 
extent to which the incumbent prefers to 
do them. Therefore, some critical ccm- 
ponents oi the job may be slighted, even 
though th, are matters of the greatese 
concern fcr teachers, pupils, the comr- 
munity, and tne school system. 


I raise tuu serious gicstion as to whether 
the examinstions, as presently conducted, 
have sufficiert statistical reliability to 
warrant their use. In this connection, I 
would be especially co:..cerned about how 
much indi dent agr. cent there is between 
two or morc persons who are grading tke 
same anrwers to the essay questions or re= 


sponses in the oral interview. If two or % 
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more raters do not agree well on their 
evaluation of candidates' responses, the 
examination will have low reliability. 
Who then is to say which candidate is 
"better" than another candidate? 

This inter-rater type of agreement is 

the most fundamental and the easiest 

type of reliability to establish for the 
essay and interview parts of the examina- 
tion. I reject the necessity for "test- 
retest" reliability studies at this point 
in time because if there is relatively 
low agreement among independent judjes 
with respect to answers from one set of 
examination questions, there is likely to 
be even less correspondence of agreement 
between two sets of scores on alternate 
forms of the test. I agree with Aaron 
Carton,who says that the “test-retest" 
procedure would be unduly arduous, but I 
go further and state that at this stage 
of the process the test-retest method is 
probably unnecessary. 

I note that several references to the re- 
liability of this examination never con- 
tain the deqree of this reliability. I 
find this odd because professionals and 
experts usually substantiate and docu- 
ment their statements when asserting a 
fact of this nature, especially when the 
issue (reliability) is so critical to 

the defense of the examinations in question, 


I note repeated references in the sworn 
statements as to the “objectivity” of the 
essay examination and the interview in 
this evaluation process. Standardization 
of the construction and administration of 
the examination (written and oral. parts) 
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a... detailed instructions on scoring do 
not turn a subjective method into an ob« 
jective one. When a person or a group 
of persons makes 4udgments, including 
those of a quantitative nature, about 
the adequacy of written and/or oral re- 
sponses of another person, the judgments 
are necessarily subjc tive. Even ano- 
nymity of the candidates does not remove 
the inherent subjectivity of tae evalua- 
tion process. ‘Therefore, I find the 
statements on the "objectivity" of these 
parts of the examination to be grossly 
incorrect and misleading. 


On many written tests minority groups 
suffer from lower scores that bar them 
from good, productivo, r2sponsible work 
While ac evadence exists that they will 
do less well on the jobs for which they 
were tested. I am firmly convinced that 
oquitable seleetion proradures can play 

a large role in nondiseximinatory umploy= 
ment. However, this equity cannot mas-~ 
querade under the faise front of "ob- 
Sectivity. Furthermore, an objective 
procedure: is not necessarily fair, and a ee 
fair procedure does not have to be ob= ae 
jective. id 
The fairncls of an employee seloction pro= 

cedure resides in its application and the 

effect its use has on employment opportuni- 

ties for perso:.s of various racial, ethnic, 

and national origin backyrounds. An employ= 

ment or an assessment procedure for promo= 
tion that screens out a disproportionately 
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high number of candidates of a particular 
race or national origin and has no demon- 


: st~ated job-relatedness cannot be con- 
s.dered fair, regardless of its real or 
_— claimed structural objectivity and the 


“good faith" in which it 22 purportedly 
used. An inadequately validated selec- 
tion procedure does not permit anyone tc 
say that an applicant is either qualified 
or ungualified to perform satisfactorily 
on a given type of job. 


Sincerely yours, 


WW Lacie vA beled 


William H. Enneis 
Staff Psychologist 
Office of Research 
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Affidavit of David Rogers verified on 
November 5, 1970 
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UNITED STATES DISTRICT COURT 


{| SOUTHERN DISTRICT OF NEW YORK 


—-— = Ole 


BOSTON M. CHANCE and LOUIS C. MERCADO, 
individually and on behalf of all : 
others similarly situated, 


Plaintiffs, CIVIL’ ACTION 


Vv. : 70 Civ. 4141 
THE BOARD OF EXAMINERS, et al., 


Defendants 
AFFIDAVIT IN SUPPORT OF 
MOTION FOR PRELIMINARY INJUNCTION 

DR. DAVID ROGERS, being duly sworn, deposes and says: 

1. I ama Professor of Sociclogy and Management in the 
Graduate School of Business Administration of New York bie 
I received a doctoral degree in sociology from Harvard University | 
in 1960. 

2. From 1965 to 1967, I held the positions of Research 


Associate and Senior Research Sociologist at the Center for Urban 


Education, a research and development laboratory chartered by the | 
New York State Board o+ Regents and set up under a grant from the | 
United States Office of Education. During that period I conducted | 
a study of the New York City public school system. This study 
formed the basis for an extensive report on the New York city 
school system which culminated in a book published by Random House, 
Inc. (New York) in 1968 under the title 110 Livingston Street =- 


Politics and Bureaucracy in the New York City 3chool System, I am 


now engaged in updating this study to cover the period from 1968 


to date. This updating includes a continued analysis of the Board: 
t 
of Examiners. 


122a 
My investigation included a study of the workings of the. 


Board of Examiners and of the examination system that it adminis- 
ters for teachers and sup:rvisors in the school system, 

4. In the course of gathering data and material relevant 
to the Board of Examiners and said examination system, I and my 
; research assistants had occasion to interview at length and on 
numerous occasions several members of the then Board of Education, 
several members of the professional staff at headquarters, includ- 
ing some who did extensive research for the lay Board of Education 
on the Board of Examiners, and several members of the Board of 
Examiners itself. in addition I conducted extensive interviews 
with outside resear:).::3 who hac studied the Board of Examiners. 

5. Throughou: + is investi.,.tion and these interviews, I 
endeavored to discover vhether any systematic attempt had ever 
been made to validate Lie examinations -- that is, to analyze them 
to determine whether scores on them were in any way related to 
future job performance. At least one member of the Board of 
Examiners acknowledged that no such attempt had ever been made, 
although it was concedcd that such analyses were needed. One ex- 
planation given was that money had never been available for such 


research. Indeed, a f-~cmer member of the Board of Examiners who 


retired in Piseile reported in an interview two years later that the 


greatest weakness in the examination syatem is that millions are 
woene on exams, but that the Board of Examiners has no research 
staff. Asocial scientist who had studied the examination system 
concurred with this judgment and concluded that the Board of 
Examiners did not have the technical competence to validate the 
exams, 

An importunt obstacle tc validating the exams is that 


the educators have not yet developed any agreed-on performance 


| 


| 123a 
| standards. This is not an insurmountable task from a technical 


point of view, but it is very difficult politically. Many social 
scientists arc agreed tnat the educators' resistance to being held 
accountable for pupil performance is a critical political obstacle 

6. My continuing studies indicate that no systematic valida 
tion studies have been done since 1968. Board of Education mem- 
bers who were actively involved in personnel matters reported in 
1969 that they never received any materials from the Board of 
Examiners about any validation studies. They indicated to ne that 
to their knowledge there are no such studies. 

7. I also investigated the extent to which the assistant 
principal and principal exams discriminated against racial 
minorities. There are no systematic data on this, but there are 
indications of the examinations' discriminatory effect. Thus, 
many black educators in New York City cited cases to me of them- 
selves or other blacks being failed on the speech exam for 
"“Southernisms". I have no precise evidence on how prevalent this 
was and how recent. Also comparative statistics indicate that 
New York City has one of the lowest representations of blacks at 
supervisory levels of any inner city school system in the nation. 

Members of the Board of Examiners and other school 
officials often say that few blacks took the exams until recently. 
This is, of course, true, but not mainly or solely for the reasons 
the educators give -- namely, that there are few who are qualified 
Numerous interviews with black educators in New York indicate that 
many of their colleagues in the city and throughout the nation 
have hesitated to take the New York City examinations lest they 
be failed and, in therr estimation, humiliated, like others before 
them. The educators' tendency to externalize the blame and their 


failure to understand this psychology of despair have led to very 


o 
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one-sided interpretations of the phenomenon, Exams for supervisor 


in the New York City school system have had a chilling or "freez- 


to the trenendous under-representation of these groups today. 
The Board of Examiners must be held accountable for that, since 


they function autonomously and have almost exclusive domain over 


the exams, 


4 Leuk tea oF 
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ing out" effect on blacks (as well as Puerto Ricans), contributing 
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of November, 1970. 
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Affidavit of Gregory G. Jones verified on 
November 6, 1970 
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UNITED STATES DISTRICT COURT 
SOUTITERN DISTRICT OF NEW YORK 


BOSTON M. CHANCE and LOUIS C. MERCADO, 
individually and on behalf of all 
others similarly situated, 
Plaintiffs, 
CIVIL ACTION 
v. 

70 Civ. 4141 

TITE BOARD OF EXAMINERS, et al., 


Defendants. 


AFFIDAVIT IN SUPPORT OF MOTION 
FOR PRELIMINARY INJUNCTION 


STATE OF NEW YORK ) 
)  Ss.: 
COUNTY OF NEW YORK) 
GREGORY G. JONES, being duly sworn, deposes and says: 
(1) I ama third-year law student at Columbia Law School 
and am Managing Editor of the Columbia Journal of Law and Social 


Problems. Over the past 10 months I have conducted a study of 


the examination procedures of the Board of Examiners and have 


reported my findings in the article, Discriminatory Merit Systems: | 


ll A Case Study of the Supervisory Examinations of the New York 
Board cf Examiners, 6 Columbia Journal of Law and Social Problems 
374 (1970) (submitted separately as exhibit 1 hereto). 

(2) I have examined the papers submitted by defendants in 
opposition to plaintiffs' motion for preliminary injunction 
including in particular the affidavit of Jay E. Greene, the 
affidavit of Murray Rockowit2 and exhibits 1], 1a, ib, 2#, 20, 2c, 


4b, 4c and 5 attached thereto, and I aubmit this 


| 
| 
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affidavit in response to those papers and in support of plain- 


tiffs' motion. 

(". Jay Greene asserts in paragraph 3 that the statistics 
ci’ec rv plaintiffs' Amended Complaint (par. 20), indicating in 
Mr. Greene's words "that there is a low percentage of black and 
Puerto Rican supervisors in the New York City school system" 
are irrelevant on the question of the alleged discriminatory 
impact of the Board's examination procedures. In support of 
this assertion he first states that “the Board of E:aminers does 
not dete: nine the eligibility requirements for applicants for 
supervisory positions . .. [a]ccordingly, the recitation of 
statistics concerning the percentage of blacks and Puerto Ricans 
among the total number of licensed supervisors, is irrelevant to 
these procecdings." (par. 3) This statement ignores the fact 
that for almost two decades it has been the examination procedures 
pot the eligibility requirements that have triggered the harshest 
criticisms by respected students of . system. Citation to only 
a few of the most respected of these studies illustrates the 
point: 2 Mayor's Committee on Management Survey, Administrative 


Management of the School System of New York City 755 et seq. 


(1951) (Strayer and Yavner); D. Griffiths, et al., Teacher Mobility 

in New York City: A Study of Recruitment, Selection,. Appointment, 
| and Prometion of Teachers in the New York City Public School 

63-65, 100, 116-27, 162-225, 230 (1963) (Griffiths Study); Mayor's 


Advisory Panel on Decentralization of the New York City Schools, 


Reconnection for Learning: A Community School System for New York} 


City 446, 111 n. 28 (1967) (Bundy Reports D. Rogers, 110 Livingston| 
Street 285-297 (1967). See also M. Schinnerer, A Report to the | 
Conmirsioner of Education, State of New York, 48-57 (1961) and 

| Cresap, McCormick & Paget, Summary Report of Assignment Conducted 

\ 


for unc new ‘york City Board of Education (1962). In D. Rogers, 


i 

110 Livingston Street 285-97 (1967) there was a particular focus 
{ 

on the suspicion that the examinations may work to the peculiar 


| disddvauie- so of minority groups. 
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(4) In paragraph 4 of his nffidavit, Mr. Groeno states that: "If statistics have 


would be a comparison of the pass-fail ratio of black and Puerto Rican applicants, "" 
It is quite true that one significant kind of statistic would be that indicating tho number 


of blacks and whites who took a particular examination and the percentage of each 


any relevancy in determining the claim of discrimination, the only meaningful statistic 


group that passed. I time and again asked interviewees during the course of my 
rescarch for just these figures. However, I was told repeatedly, most notably by 
defendant Murray Rockowitz and by Mrs. J. Luisette, Assistant to (former) 

|| Chairman of the Board of Examiners, Jay Greene, that no such data was available. 
Yet Mr. Greene reported in the Board's 1968-1969 year-end report that "...the 

| munber of ininority group applicants in supervisory examinations has increased 

| 

substantially...."" (Exhibit 2 par. 9), And Mr. Greene in his affidavit cites 

| to statistics indicating the race of applicants for a few examinations which are 

| curiously favorable only to defendant's position (See Greene affidavit par, 5 at 3) 

Mr. Greene also refers in par. 6 to the small number of “eligible black 

and Puerto Rican applicants" and seeks to explain the relative paucity in pars. 6 

;and 7. He fails, however, to mention a factor reported to me in an interview with 

| Mr. Frederick H. Williams, Assistant Superintendent, Office of Personnel, who 

| is in charge of recruitment for minority group educators. Mr. Williams said that 


| he believed the examinations themselves explained in part the relatively unsuccessful 


efforts to recruit black and Puerto Rican applicants for supervisory positions. 
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5) Mr. Rockowitz th his affadavit at par. 21 and in Exhibit 5 asserts that tho 


article I wrote is "replote with false Ataternents, misquotations and other inaccuracios, ' 


A caroful review of my rather lengthy notes of the interview, on March 24, 1970 in 


Mr. Rockowitz's office, indicates no inaccuracies whatever, Morecver, a careful 
review of his allegations with respect to statements in my article indicates that he 
challenges very few factual statements, but rathor argues with certain conclusions that 


; I drew. In addition, | might add, he complimented me for coming to the interview well 


prepared in terms of my understanding the Board's procedures and the basics of testing 


! 


procedures in general, Finally, I should Sfy As an introductory remark that 


| 


Mr. Rockowitz was quite well aware that I was a staff member of the Journal and that 
the interview was for publication in the article I subsequently wrote, | will not take the 


time to refute the more petty of his alleg; ‘tions, but will comment only on those of his 


assertions that are relevant to these proceedings, 


(6) Mr. Rockowitz disputes the accuracy of my article with respect to the 


Board's efforts at job analysis, the general adequacy of research efforts by the Board, 


!' the com; cence of "examination assistants" who actually construct the tests, and the 
nen BSSIStants!! 


validation efforts by the Board, 
ere | 
i Job Analysis Efforts by the Board 


(7) A job analysis is the first step in test development. To conduct a successful 


analysis the researcher must have a wide background in psychology and the analysis 


must hoe specific and in detail. If properly done, such an analysis yields a description 


of the major activities of the position and their relative importance and in addition 
indicates what kind of performance or personal or professional characteris:ics make 


for success on the job. L, Cronbach, [sscntials of Psychological Testing, 407 passim 


(3rd Edition, 1970), 


Leyva 


(8) Mr, Rockowitz asserts at par. 10 of his affadavit and at par. 3 of Exhibit 5 


attached thereto that "there is a systematic empirical analysis for each position for 
| which the Poard of Examiners conducts tests," but cites only to the "duties of position" 
| 


(see Exhibit 3 of Rockowi‘z affidavit) as evidence of these analyses. In our interview, 


Mr. Rockowitz said that the "duties of tho position" woro acceptod "a priori" ns 


ot 
| criteria of job success and indicated unambiguously that this was not a desirable 

practice, He said that prior to the plan he refers to in par. 4 of Exhibit 5 thero was 
| never any systematic research into criteria of job success. Rockowitz said that the 
stimulus for the proposal was the passage of the 1967 Amendment to the New York 
Education Law which requires the Board to periouically review the validity and 
reliability of the examination and examination procedures, 

(9) Similarly, in an anonymous interview with a senior official at the Board of 


Education, who for obvious r2asons wishes to remain anonymous, I was told that while 


formally it is the duty of the Board of Education to establish the "duties of position" 


in practice, requests are sent to incumbents of the position who list "duties, "' based 
on their personal ia: which are "frequently accepted verbatim," The Board's 

| research efforts were characterized as "haphazard" and as a “bigempty arca." In 
fact, the official told mo that ho personally participated in drawing up tho "duties" for 


tho oxamt{nation which ho himself was schedulod to take, 


Absence of Research | 
ae ee 


(10) Explaining tho relative absence of such basio research by the agoncy 
formally dedicated to that goul, Rockowitz said the "Board is research waeesd. ” 
Elaborating, he said that privr to 1967 there had bees no more than one permanont 
staff rescarcher employed at any one time in the entire history of the Board. 
Rockowitz said further that 'no examiner was assigned to research por se until 1967," 
fat which time Rockowistz himself was so nseignod), although prior to 1967 there wos 


t 
a "Research Associate," Dr, Gerhard Lane, 


, * 
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love 
(11) Mr. Rockowitz said he increased the permanent rescarch etaff to tw 
Dr. Dena Titlebaum and Mr. James Lec. Rockowitz also said, however, that although 
ho has been assigned to research, he still has many administrative duties as well. 


(12) Mr. Rockowitz blamed principally the Board of Education for the relative 
bar ic 


absence of‘ rescarch by the Board of Examiners. Ilo fummarizced this criticism in the 


following quote, authorized for publication: "Funds have not been available over the 
years for a sufficiently comprehensive ongoing program of research." This quote is 


' cited in my article (see Exhibit 1 at 386). Mr. Rockowitz said further that there 


was "no real philosophy of research at the Board" since the development of such a 


| philosophy was precluded by the fact that the Board was flooded with the burdens of 


administering tests. 
(13) Yet now Rockowitz asserts at par. 16 that: 


".,.the Board of Examiners has regularly conducted resear:* 
in an cffort to improve its testing procedures, Such researc, 
has been curricd on for many years and in incorporated in 
humerous published and unpublished reports, " 


and similarly at par, 13 of Exhibit 5: "The Board of Examiners hus had a Research 


Committee and a Rescarch Associate for many years." 


(emphasis supplied) 
(14) Mr. Rockowitz's assertions ignore the crucial faci stated quite clearly 
in a 1966 Board study which Rockowitz seems to cite in his Exhibit 5 at 8 (7.) as 


| evidence of a Board of Examiners validity study: 


- (jt has been a source of dissatisfaction to {the Board] 


to note the repeated diflic nulties in obtaining a research : tall to. 
embark on the funds mental proble ns Of studies of validity ar and 


reli: jability ol procedures, itis, furthermore a source of 
chagris in to note that the problem of selection of se chool personnel 

sia al Ss etch hdl etch ft dca 
nas hes n 1 uncler-investis 5 aed, dee pile its eo sinnifies mee 


+ ee cm 


In an effort to turn attention to the probicm of selection 
of school personnel, the Board of Examiners has undertaken 
the study, now being prefaced. The first question to be asked 
is: ‘How do large school systems select theis nersonnel?' ‘this 
is a necessary preliminary to the more findamental, more 
difficult questions involving evaluation of procedures, which 

eventually must be porcd." Ti, Gilbert, 1. Lopden, | G. Lang, 
Kalick, Teacher Selection Policies and Procedures in large 


Public School Systoms in tho United States fii (1966). (emphasis 
supplied) 


l3la 
Obviously, this study which is on file ai the Columbia University Teachers College 
} 


Library, ie not a validity study, but simply what {ts title indicates: f& Compilation 


of the selection procedures of other large school systems. A citation to this bludy 


does indeed appear in my article at 386 n. 104, but clearly not ina self-contradictory 


| manner, 


Training of "Examination Assistantg't* 


(15) The extent *e which "examination assistants" assigned to the Board have 
|| Professional training in tost construction, design, measurement, and statistics is 


cruvial, for thoy aro tho porsonnol whe are heavily relied upun ty actually conuleuet 


the tests that constitute a particular examination, 
| Mr. Rockowitz at page 3 (G) of “xhibit 5 asserts: 


"Those assigned to the Board's ataff as assistant 

examiners in fact nave had wide experience in the construction 
and administration of teats, In addition, they are trained 

through comprehensive briefing sexsions and detailed written 
guidelines in the construction of test items. " 

| 


in responso tothe statement in my article that: 


| 
| ",..[I]t has been conceded that those assigned to the Doard's 
| staff as 'cxamination assistan(s' have had no expericnce whatsoever 
| in professional test construction, Understanding the principles 


of professional test development simply hae not been one of the 
requirements for the job," 


(16) In my interview Mr. Rockowit» said that the "sub® ct matter experts in 


| the field" (not test experts) submit questions and answors which the "examination 


| 


| assistants" assijmed to the Board "review" and "edit." Ina subsequent interview, 
| 


| also on March 24, 1970, with Mrs. J. Luisette, who served as an “examination 


| 


SeeeesnatneeeieEeeeeee 


| *It is a matter of indifference to me whether Mr. Rockowitz wishes to label as 
"examination assistante" or "assistant examiners" those pereons actually assigned to 
the Loard to construct the teste for examinations, What is ¢rucial about the personnel 
who porform this function ig discussed above in irs, 16-17, Noverthelees, 1 might 


although the former group also includes “subjoct mattor" oxyerts from outside the 


syatem who as a practical matter would not be assigned to the Board as "assistant 
exam inors, " 


| ie 


Bay that, in point of fact, it appears that tho Jutter aro moroly a subgroup of the formor, 
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assistant" assigned to the Board for cight ycars (unt). 1968) and who was serving at the 
time of the interview as Assistant to (former) Chairman of the Board of Examiners, 

| Jay Greene, I was told that tho "review" and "edit" process consisted principally of 
: | "“proofrouding."" I repeated! .sked Mrs. Luisctto whethor professional tost experionce | 


was a condition to employment as an "examination assistant." She responded negatively 


| 
| 
i] 
without hesitation on each occa ‘~n. I then asked Mrs. Luisette what then were the | 
! criteria by which "cxamination assistants" wero scloctcd. In answer to my qucstiun | 


| Mrs. Luisetie gave me a copy of "Swnmary of Mecting with CSA [Council of 


| 


Supervisory Associations]: ‘Selection and Assignment of Examination Assisians. ' 


(Dec. 29, 1969) (attached as Exhibit 3 ), Among the participants at the mecting was 


| defendant Unser, then Vice Chairman of the Roard of Examiners. The following quotes 


| from the Swnmary illustrate rather conclusively that professional training in test 
construction is not a condition to employment as an "examinr*inn assistent": 


"Current practice is to select persons on the basis of 
their educational background, professional expericnce, 
reliability, integrity, judgment, and personality... .The 
qualifications of potential assistants are evaluated by study 
of their personnel files and by checking with supervisors 

or colleagues. 


| 

"1, The Board of Examiners has been considering | 
some more formal way of testing the qualifications of persons | 
\ 

! 

| 

} 

| 

| 

| 

{ 

\ 


who wish to servo." (emphasis supplicd) 
(17) Mrs, Iaisotte said sho actually "constructed" the tests for a munber of 
oxaminationa, The only guidclinos in test construction sho said she received wero 


mechaical instructions indicating, for example, that questions should be typed on 


tho opposite sido of the card from the answer, According to Mr. Rockowitz, the 


; Board has just recently begun providing "examination assistants" with item analyses 
of tho short-answer questions for cortain examinations. 


Validation 


(18)' ‘'ho most crucial staye in tost devolopmont is validation, In this 


connection Rockowitz at p. 6 of Lxlibit 5 assarts: 
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"The Board of Examiners has complied with the New 
York Stato Education Law by reviowing the reliability and 
validity of ifs oxamunetions in 22 separate studics since the 
Law was enacted, " 
Evidently in these purporten studies, the Board has Stressed content validity rather 
than predictive validity (criturion-related validity), Tho latter is preforred by test 
ction and classification procedures, see a, £ 
» Cronbach, Essentials of Psychological Testing, 407 @rd Edition, 1970), 
A. Anastasi, Fields of Applied Psychology, 28 (1 968) and is emp, sized by the EEOC 
and required by the OF'CC whenever feasible, The cites to EEOC guidelines and 


Executive Order pertinent to the OFCC may be found in my article at 382 n, 69 


|| (Seo Exhibit 1 ), 


| (19) Mr. Rockowitz cites in Support of his claim of 22 reliability or validity 


| Studies only a few “summarics" of purported validity studies in Exhibit 4c and in 
addition ho cites an unpublished predictive validity study at par, 16, p. 9 of his 
affidavit, 

During that part of our interview in which we discussed the Board's cf{forts to 
validate its exnms, Rockowitz made no mention of content validity studies, le stated 
quite unainbijuously that the Board had not ru any empirical predictive valility 
studies on the exams. io did Say that the Board wag preparing item analyses of the 
short-answer tests through the cfforts of Mr. Lev and Dr. Tillebaum and that the 
Board applied face validity analysis to the exams. Item analysis has no direct hearing 


on tho validity of the exams, and test experts assort that face validity is an wnacceptable | 


substitute for cithor content validity or predictive validity, (Seo Exhibit 1 » at note 
90 und accompanying toxt) 7 

In this connection I asked Mr. Rockowitz about the Board's "pilot" predictive 
validity study reported in the following manner in the Board's 1968-1969 year-end 
report: 


"Research activities with a limited research staff included 

a pilot study of the relationship between our CXuninations and 

Success on the job as principal.,,," (Sce Enhibit 2 , p. 2, par. 13) 
9 


| 
| 
| 
| 
| 
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Rockowitz said that the study was cancolled because of an insufficient population as a 
source of criteria for success, that is, an insufficient population of those who could 


rate on the job performance of.principals. Rockowitz said there was only a population 


of one, the Fie} * Superintendents ,whose ratings for various reasons proved inadequate. 


Mr. Roc cowitz now maintains the study was completed, though unpublished. 


i Jt is significant, however, that in the view of defendants expert the study was "modest" 


and "exploratory" in scope and "encountered a number of methodological snags," 
(Exhibit 2c at 5 attached to affidavit of Rockowitz). 
Mr. Rockowitz quite frankly conceded fn the interview that he did not know how 


valid the exams were and that theoretically they could arbitrarily exclude qualified 


/applicants and admit unqualified applicants, 


— 
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Affidavit of Stanley Taylor verified on 
October 23, 1970 


4578 
IN THE 

UNITED STATES DISTRICT COURT 
FOR THE 

SOUTHERN DISTRICT OF NEW YORK 
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BOSTON M. CHANCE and 
LOUIS C. MERCADO, et al., 


Plaintiff., 


Ve 
BOARD OF EXAMINERS, et al., 
Defendants. 
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AFFIDAVIT IN SUPPORT OF 
MOTION FOR PRELIMINARY INJUNCTION 
Nee eane—eneeonsnsansnane dee 


STATE OF NEW YORK ) 
2 BBe% 
COUNTY OF NEW YORK) 


Mr. Stanley Taylor, being duly sworn, deposes and says: 

1. I am the Community Superintendent of School District 13 in 
Brooklyn, which includes the Bedford-Stuyvesant and Fort Greene area, My 
experience as an educator prior to becoming Superintendent of Community 


School District 13 consists of; Principal of J.H.S. 294K District 13, 


Intern Principal of J-117K, Internship at Fordhan University, Assistant 
Dean of Sheepshead Bay High School, Acting Chairman of Health Education in 
JeHS.'s, Administrator of School Lunch Programs, Safety Programs, Adminie 
etrator of High School Cross Country Track Team as well as Administrator 
of Interior of School Traffic Programs » Administrator of Summer Programs 
in Continuing Education, Principal of Sumer Day Elementary School, all 
in New York City. 

2+ Of the 25,509 students who attend School in District 13, 
approximately 73.7% are black, 21.8% are Spanish-speaking, and 5% are 
white. 

3+ Three vacancies have existed for the position of principal 
Since I became Superintendent. Each candidate fer these positions has 


been examined by mo, tho District Hoard and by the parenta’ asaectatiun in 
the school affected. Careful consideration wag given to a defined aot of 
qualifications, including: 

(a) Human qualities, such as leadership, reliability, stamina, 
sensitivity, the ability to work under pressur6é and to make decisions, 

(>) Fundamontal attitudes ~ ara thoy positive, innovativo, 


and energevic? 


(c) University education, including whether the person has 
the appropriate State certifica‘e. 

(d) Practical experience in education, especially exporience 
with Black and Spanish-3peaking students. 

(e) Acceptability as a member of the community.(Does the 
candidate reside in the community? Does the candidate speak Spanish?) 

(f) Administrative eapabilities, 


(g) Comprehension of community problems and aspirations, 


- 


, 


‘ he Rogardlas3 of whether the candidate was on the Supervisory 
ee 


list, we found it necessary to ascertain 40 our own satisfaction that he or 
she met the criteria listed above keeping in mind that we were seeking the 
best person for a particular school in our district, 

5. It was my experience that those fram the List did not uniformly 
display greater competence than other candidates, and I believe that mere 
passage of the test is no agsurance of appropriate qualifications. The 
examination procedure does not Seem to measure any Significant differences, 
nor to be corrolated to Judgment and the ability to perform on the job. 

6. Ad a result of our ocreening procesa, we appointed one Asate 
Principal from the Supervisory list, and three Principals not from the list, 

7. The Principals not from the list are performing exceptionally 
well; they seen to function as well as and in sone instances better than 
other Principals in tho District, 

8 The net result of tho exanination seems to be that the number 
capable persons from minority groups on the list is severely limited, ly 
explanation for this is two-fold. First, it is my belief that there is a 
certain amount of inbreeding in the selection proce3s since the Assistant 
Examiners have evidently been trainod in tho techniques of writing sterile 
non-relevant ansimrs to hypothetical questions and presumably requiro the 
dame from candidates, Second, it io my understanding that minority candi- 
dates boliove that no mors than a soloct fow have on opportunity to pasa; 


e2ea 
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ee 
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hence, many do not deem it worthwhile to submit to the process. 

9, It is my belief that if this type of examination were to be 
the yardstick for selecting the administrative leadors of the '70's our 
schools could not progress toward the changes that are necessary We 
would lose doubly because the number of talented Black and Spanish-speaking 


school administrators would be kepf to an abnormal minimum. 


Stawiey Taylor 
Community S ofrintendent 
District 13 


Signed and Sworn to before me 
rt : 
this ao day of CCWSER, 1970, 
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Notary Pubiic 


MOE KORENMAN 
Notary Public, State of New Yor 
No. 24-7338700 Qual. in Kings Co 
Commission Expires March 30, 1972 
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Amended (second) Complaint filed on 
February 23, 1971 
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BOSTON M. CHANCE, LOUIS C. MERCADO, 


CLARA BURGESS, FAITH RINGGOLD, SHIRLEY RAN-: 


DALL, MARIA C. CESTERO, EDWARD BONNEMERE 
and MARIA SANTOS, individually and on 
behalf of all others similarly situated, 


Ve 


THE BOARD OF EXAMINERS AND THE 
BOARD OF EDUCATION OF THE CITY OF 
NEW YORK; 

“RTRUDE E. UNSER, individually and in 
her capacity as Chairman of the Board 
of Examiners; 

JAY E. GREENE, MURRAY ROCKAWITZ and 
PAUL DENN, individually and in their 
capacities as members of the Board 

of Examiners; 

MURRY BERGTRAUM, individually and in 
his capacity as President of the 

Board of Education: 

ISAIAH E. ROBINSON, CR., individually 
and in his capacity as Vice-President 
of the Board of Education; 

MARY E. MOADE, SEYMOUR P. LACHMAN, and 
JOSEPH MONSERRAT, individually and in 
their capacities as members of the Board 
of Education; 

HARVEY B. SCRIBNER, individually and in 
his capacity as Chancellor of the City 
School District of the City of New York; 
and FREDERICK H. WILLIAMS, individually 
and in his capacity as Executive Director 
of the City School District of the City 
of New York. 
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JURISDICTION 


IN THE UNITED STATES DISTRICT COURT 
FOR THE SOUTHERN DISTRICT OF NEW YORK 


CIVIL ACTION 
No. 


70 Civ. 4141 


AMENDED 
COMPLAINT = 
CLASS ACTION 


1. This is a civil action brought under Title 42 U.S.C. 


|| §1981 providing for the equal rights of citizens and of all 


persons within the jurisdiction of the United States; Title 
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42 U.S.C. §1983 to redress the deprivation under color of state 


law, statute, ordinance, regulation, custom or usage of rights, 


| 

| privileges and immunities secured by the Fourteenth Amendment to 
| the Constitution of the United States; Article $5 §6 of the New 

| York State Constitution and §2590-j 3 (a) (1) of the New York 
Education Law, requiring that merit and fitness, as determined 

|| by examinations, be the basis for appointments and promotions in 


|, New York City public school system; §2569(1) of the N. Y. Educ. 


|| Law guaranteeing the validity and reliability of examinations and | 
i examination procedures in the New York City public school system; 

| and 52573(10) of the N.y. Educ. Law vesting in the Board of 

|| Education of the City of New York exclusive authority to 


|| establish the academic and professional qualifications for the 


City license of principal and of certain other positions, to 
enjoin violations thereof. Plaintiffs also seek a declaratory 
judgment pursuant to Title 28 U.S.C. §2201. ‘The matter in con- 
troversy, exclusive of interest and costs, exceeds the sum of 
ten thousand dollars ($10,000.00). Jurisdiction is conferred on 


| this Court by Title 28 U.S.C. §§1331 and 1343(3). 


CLASS ACTION ALLEGATIONS 


2. Plaintiffs bring this action in their own behalf and 


Rules of Civil Procedure. The class includes all those who (1) 
have failed supervisory examinations for which eligibility lists 
are to be published or are eligible to take supervisory exami-~ 
nations to be given in the future and (2) are members of minority 
groups who suffer from cultural disabilities imposed by 


{ 
| 
| 
as a class action pursuant to Rule 23(b) (1) and (2) of the Federa 
een patterns of educational and social discrimination or 
' 


- 2« 


| 
| 


| 
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are untutored in the esoterics of test-taking in the New York 
City school system. 

3. 5% would be unduly burdensome and impractical to enumerate 
exactly the members of the class; however, a rough approximation 
indicates the number to be in the thousands. Deputy Chancellor 
Anker has indicated that the blacks and Puerto Ricans eligible 
for merely one supervisory examination scheduled for the fall 
(the elementary schcol principals’ examination) number somewhere 
between three and four hundred. New York Times, July 24, 1970. 
On information and belief, fourteen additional supervisory 
examinations are presently scheduled for 1970-71, suggesting the 
existence of several hundred more eligibles from minority groups. 
Furthermore, on information and belief, a number of eligibility 
lists established pursuant to supervisory exams already given 
are about to be published, indicating the existence of additional 
members of the class, numbering in the hundreds, 

4. Plaintiffs are members of the class: both plaintiffs ar 
eligible to take a supervisory exam scheduled in the future 
(the elementary school principals’ exam) and both are members of 
culturally disadvantaged minorities (Mr. Chance is black and Mr. 
Mercado is Puerto Rican). 

5. The members of the class, numbering in the thousands, 
are so numerous as/to make joinder impracticable. 

6. Clearly, there are questions of law or fact common to 
the class. The alleged discrimination in violation of the 
Fourteenth Amendment has a similar negative impact on the interes 
of each member of the class. Administration of unvalidated exams 
in violation of the provisions of N.Y. Educ. Law §§2569(1), 


2590-3 3(a) (1) and of Article v, Section 6 of the New York State 
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Constitution obviously will have a particularly onerous impact 


on the class describ .n Paragraph (2) Supra. In addition, the 
existence of common questions of law or fact is implicit in a 
finding that the class action satisfies the requirements of 
F.R.C.F. 23(6) (1) or (2). 

7. The claims of the representative parties are typical of 
the claims of the class, and the representative parties will 
| fairly and adequately protect the interests of the class. It is 
tieicus that the named plaintiffs share the issues and interests 
of the absentee members of the class. All members of the class 
are barred from permanent supervisory positions in the school 
system because they have no license. Both the named plaintiffs 
; and unnamed members of the class are members of minority groups 
who are eligible to take supervisory examinations, all of which 
are alleged to be discriminatory, invalid and otherwise in 
violation of the law. There is no suggestion of any antagonistic 
interests among members of the class. It is equal’. obvious 
that both named plaintiffs intend to prosecute the nterests of 
the class vigorously. Both clearly desire permanent supervisory 
positions. Both Mr. Chance and Mr. Mercado are presently serving 
as acting principals; both are eligible for the position of 
principal, elementary school except that they do not possess 
the requisite license; Mr. Chance has taken and failed one 
previous supervisory examination. Thus, it is clear that the 
intense commitment of the named representatives to the goal of 
declaring invalid and enjoining the present system of examining : 
and licensing supervisory personnel in the school system is 


unassailable, and that this goal is coextensive with the interests 
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of the other members of the class. 


PARTIES 


8. Plaintiff Boston M. Chance, who has been employed in the 


H pedagogical service of the New York City public school system 


| for the past 15 years, is black, holds a New York State principal’ 


certificate, and is acting principal ‘ Public School 104, an 
elementary school in the Bronx. Plaintiff Chance possesses all | 
the educational and experience qualifications established by law | 
and by the Board of Education and the Chancellor of the New York 
City School District for the position of principal, elementary 
school. He is barred at present from being appointed permanent 


principal because he does not have a New York City license as 


elementary school principal. 


9. In September, 1968, plaintiff Chance took the 3 


conducted by defendant Board of Examiners for the position of 


examination and therefore was not on the eligibility list 


established July 15, 1969, for said position, and was not issued 


= Principal, Jr. High School. He failed to pass that 


a license entitling him to permanent appointment in said position 


| 10. Plaintiff Louis C. Mercado, who has been employed in th 


pedagogical service of the New York City school system for 12 years, 
is Puerto Rican, holds a New York State principal's certificate, 

and is acting principal of Public School 75, an elementary school 
in Manhattan. Plaintiff Mercado possesses all the educational 

and experience qualifications established by law and by the Board 
of Education and the Chancellor of the New York City School | 


District for the position of principal, elementary school. He 


is barred at present from receiving appointment as permanent prin- 


| cipal because he does not have a New york City license as 


a 


lta 
elementary school principal. 


10a. Plaintiff Clara Burgess, a resident of the City of 


| 
| 
ts york, is black. She has been an employee of the New York 
City public school system for seventeen (17) years, and is 

| 

| 


| presently Evaluator of Head Start Prvgrams for Community School 

|| District 7. Plaintiff Burgess n»%lds state certification for 

|| elementary schooi principal, and is a candidate in the most recent 
| examination for the New York C..ty license of elementary school 

| Principal. the written portion of which was given on November 3, 
|| 1970. 

10b. Plaintiff Faith Ringgold, a resident of the City of 


New York, is black. jie has been an employee of the New York City 


public school system fur fifteen (15) years, and is presently a 


teacher of art at ~ deis High School. She is also a lecturer in 
art at Bank Street College and Wagner College. Plaintiff Rinygold 


failed the examination of defendant Board of rfxaminers for the 


New York City licens. of supervisor of art which commenced in 


March, 1968. 

10c. Plaintiff Shirley Randall, a resident of the City of 
New York, is black. ‘he has bec . am employee of the New York 
| City public school system for fifteen (15) years, and is presently 


|a teacher of retarded children at the Bronx Occupational Training 


|| Randall is a candidate in the most recent examination for the 


|| New York City liconae of “upervisor in the Bureau of Children of 


wee a facility of defendant Board of Education. Plaintiff | 
| 
| 
| 


Retarded Mental Deveiupment, the written portion of which was 


wae in June, 1970. 

| 

Ht 10d. Plaintiff Maria C Cesterqa resident of the City of 
i| 

! 

| 
1 
} 


New york, is Puvert. rican. She has been an employee of the New 


York City public school system approximately fourteen (14) years 


® 
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and is presently acting principal of Public School 120, an 
elementary school in Brooklyn. Plaintiff Cestero holds state 
certification for elementary school principal. She failed 
the examination of defendant Board of Examiners for the license 
of Assistant Principal of Junior High School which commenced in 
Septemb«r, 1968 and is a candidate in the most recent examination 
for ie New York City licenses of Elementary School Principal, 
the written portion of which was given November 3, 1970, and for 
Administrative Assistant of High School, the written portion of 
which was given December 29, 1969, 

l0e. Plaintiff Edward Bonnemere is black. He has been an 
employee of the New York City public school system for fifteen 
(15) years, and is presently a teacher of music at Intermediate 
School 55 in Brooklyn. Plaintiff Bennemere failed the eleanieees 
of defendant Board of Examiners for the New York City license of 


Chairman of Music for Junior High School, commenced in or about 


1966. 


10f. Plaintiff Maria Santos, a resident of the City of 
New York, is Puerto Rican. She has been an employee of the New 
York City public school system for seventeen 17) years, anu is 
presently Coordinator for the study of English as a second 
language for Community School District #9 in the Bronx. Plaintif 
Santos holes state certification for secondary school principal. 
She failed examinations of defendant Board of Examiners for the 


New York City licenses of Junior High School Chairman of Foreign 


administered in or about 1966. 


Languages and Senior High School Chairman °*¢ Tu_esign Languages, 


|| designate the academic 
{ 


teachers' and superviscrs' 


46a 


ll. 


Defendant Board of Education exists pursuant to the 


laws of the State of New york (N.Y. Educ. Law §§2552 and 2590<b) 


and is declared by law to be a body corporate (N.Y. 
§2551). 


Educ. Law 
faid Board of Education is empowered and required, 


inter alia, to establish and maintain such free elementary and 


other schools as it deems necessary to meet the needs and demands 


| Of the City of New york (N.Y. Educ. Law §2554(9)): and to 


and professional qualifications required 
for the license of principal and of certain other positions 


(§2573(10), N.y. Educ. Law). Defendants Murry Bergtraum, Isaiah 


E. Robinson, Jr., Mary E. Meade, Seymour p, Lachman, and Joseph 
Monserrat, constitute the membership of defendant Board of 


kdjucation. Their terms extend to July 1, 1971. 


12. Defendant Chancellor Harvey B. Scribner is chief 


administrative officer of the City School District of the ci 


vy of 
New York and functions pursuant to §2590-h of the N.Y. Educ. Law. 


Said Chancellor is empowered and required, inter alia, to 


promulgate minimum education and experience requirements for all 
supervisory service positions (N.Y. Educ. 


3. 


Law §2590-4(2)). 
Defendant Deputy Superintendent of Schools Theodore H, 


Lang is the chief personnel officer of said school district. 


14. The Defendant Board of Examiners exists pursuant to the 


laws of the State of New York, discharging governmental functions 


(N.Y. Educ. Law §2569(1)). Said Board of Examiners is enpowered 


and required, inter alia, to prepare and administer examinations 


to determine the merit and fitness of applicants for New York City 


licenses (N.Y. Educ. Law §2590~4 (3) (a) 


(1)). Defendants Gertrude E. unser, Jay E. Greene, Murzay 
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Rockawitz and Paul Denn are members of said Board of Examiners. 


FACTUAL BACKGROUND | 
15. The New York City public school system is composed of | 
916 schools, and has a pupil population of 1,123,165 that ia 
33.6% black and 22.2% Puerto Rican. Said system employs 


approximately 937 principals or others in charge of schools, 


| 1,851 assistant principals and administrative assistants, 943 
t de dke Geant chairmen, 1,465 guidance counselors and 62,891 day 
teachers. 

16. In order to obtain a permanent appointment to any 
supervisory position, an individual needs an appropriate 
New York City license (N.Y. Educ. Law §§2569, 2530-j(1), (4)b, 


(4)d). Such licenses are issued by defendant Board of Education 


only to persons who meet qualifications that it and the Chancello 


have established as required by law, and who have passed an 


examination procedure prepared and administered by defendant 


Board of Examiners. These licenses are in addition to state 


requirements for supervisory positions. Of all the school 


districts in the State, only the City School District of the City 


of New York maintains a Board of Examiners and this specific 


examination and licensing procedure. Indeed the only other 


school district in the state in which the law provides for 


examinations in addition to state certificate is Buffalo. N.Y. 


Educ. Law §2573(10—a). 


17. Were it not for New york's examination and licensing 


procedure, pla‘:‘! 7fs Chance and Mercado would be appointed 


permanent elementary school principals. Both already have 


attained State certification for that position, and both were 
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selected for their present acting principalships by their 

respective community school boards, in accordance with New York 

City's decentralized system, after extensive selection processes. 
Moreover, both are specially trained to be principals, having 

| graduated a year-long Fordham University Instructional 

|| Administrators and Principals Internship Program in Urban 
Education. 

18. There is at present no outstanding list for the positio 

| Of elementary school principal. The Board of Examiners has 

announced its intention to hold an examination procedure for the 

| position of elementary school principal on November 3, 1970, and 

|| to promulgate a new list in the Spring of 1971 based on such 

procedure. If plaintiffs Chance and Mercado do not pass such an 

examination procedure, they would have to be removed from their 

present positions--notwithstanding the merits of their per-= 
formances—=-and replaced by persons on such a new list pursuant 

to N.Y. Educ. Law §2573(2); Board of Education By-Law 101(3). 

19. Upon information and belief, in addition to the 
examination for the position of principal, elementary school, the 
Board of Examiners has scheduled approximately 14 other supervisory - 
examinations for the year 1970-71. Upon information and belief 
said Board will in the coming months promulgate numerous 
eligibility lists and issue licenses for yet other supervisory 
positions based on past examinations. 

20. There are approximately 1,000 persons who hold a city 
license of principal for some level of the New York public school 


system. Most = but not all - such persons actually head schools. 


- 10. 
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Others function in various administrative positions. Of the 
licensees only 11 are black (about 1% of the total) and only one 
is Puerto Rican. Upon information and belief, out of approximate 
750 persons licensed as principal for New York City elementary 
school, five are black (less than 1% of the total) and none is 
Puerto Rican. The percentage of persons licensed for other 
supervisory positions who are black or Puerto Rican is also 


| 


| strikingly low compared to ‘heir percentage of the school student 


the 180 administrative assistants for high schools none are black 


or Puerto Rican. Of the 1610 assistant principals, junior high 


population. Thus, for example, upon information and belief, of 
and elementary schools, only 7.0% are black and .2% Puerto Rican. 
Further, at the time the list for the position of principal, 
elementary school, was originally promulgated, of 340 persons 
on the list only 6 or 1.8% were black and 0 were Puerto Rican. 
At the time the list for principal, high school was promulgated 
there were no blacks or Puerto Ricans among the 22 persons listed. 
At the time the list for principal, junior high school was promul- 
gated, of the 115 persons on the list only 1(0.9%) was black and 
1 (0.9%) Puerto Rican. At the time the list for assistant 
principal, junior high school was promulgated, of the 690 persons 
| 
| 


on the list only 55(8.0%) were black and none were Puerto Rican. 


accounting for this low percentage in minority group personnel. 
The percentage of New York City school supervisory personnel who 
are black or Puerto Rican is strikingly lower than the comparable 
figures for the four next largost cities in the United States, 


22. The Board of Examiners testing procedures are biased 


|| against blacks and Puerto Ricans. They frequently emphasize 
| 


| 


21. The Board of Examiners procedures are the major factor 
is cultural facts unrelated to the supervisory positions 
| 
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in question. Moreover, these tests place a premium on familiar- 
ity with organizational peculiarities of the New York City school 
| system which, while having little to do with educational needs, 
are largely gained through coaching and assistance from present, 
| } predominantly white, supervisory personnel. Blacks and Puerto 


Ricans, not having had equal access with whites to such treatment 


¢ 


! are at a severe disadvantage with respect to Board of Examiners 
| tests. 

| b The testing procedures do not indicate a candidate's 
| ability to do the job being tested for. There is no evidence | 
| 


that they moasure merit or fitnoss, they have never been validated, 


and they are unreliable psychological instruments. Moreover, 

they are not objective in their assessment of candidates but, on 
the contrary, are highly subjective. Upon information and belief, 
most or all such testing procedures contain written and/or oral 
portions. The questions are composed, and the candidates are 


evaluated and rated, by examination personnel who have had no 


| training in professional tent administration. Such examination 
personnel thus necessarily render their judgments -- both as to 
the pertinency of the questions and the appropriateness of the 
responses -- on the basis of their individual subjective predi- 


lections. There has never been any empirical study to determine 


whether these questions and the method of evaluating responses 
measure or predict a candidate's ability to do the job for which 
a test is givon. 
24. Moreover, because -ha established discriminatory 
reputation which these Boards of Examiners procedures have in 
| the block and Puerto Rican communities, a large portion of 


otherwise eligible minority group persons have been discouraged 


at ee a 


| 
| 
| from secking a license. 
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VIOLATIONS OF LAW 


25. The administration by defendant Board of Examiners of 
unvalidated supervisors examinations, which has effected without 
any rational justification a racial classification because of the 
dearth of blacks and Puerto Ricans licensed therefrom, is a viola- 
|! tion to the right of plaintiffs and their class to equal protec- | 
tion of the laws as guaranteed by the Fourteenth Amendment to the 
Constitution of the United States. Plaintiffs and their class 


have no adequate administrative remedy available to them to 


for supervisory positions in the New York City School system. 


26. Article V §6 of the New York State Constitution states 


| challenge and prevent defendants' conduct and use of examinations 
x pertinent part: 


service of the state and all of the civil 
subdivisions thereof, including cities and 
villages, shall be made according to merit 
and fitness to be ascertained, as far as 
practicable, by examination... . 


Moreover, §2590-j 3(e)(1) of the New York Education Law states 
in pertinent part: 


Tne board of examiners shall prepare and 
administer objective examinations to 
determine the merit and fitness of all 
candidates for . . . supervisory service 
positione .... 


| 
Appointments and promotions in the civil 


The testing procedures of defendant Board of Examiners, being 
neither objective nor being measurements of merit and fitness 


for the particular jobs involved, and yet being a basis for pro- 


motion in the civil service, are conducted in violation of 
Article V §6 of the New York State Constitution and §2590-j 3 (a) 


(1) of the New York Education Law. 


A 
ooo 


aT. Section 2569 subd. 1 of the New York Education Law 
states in pertinent part: 
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| + « « The Board[of Examiners] shall 
| periodically review the validity and 
! 


relicbility of o:aminations as well as 
examination procedures ..., 


Although this provision has been in effect since 1967, the Board | 


| 
| 


“ Examiners has never complied with it. This provision repre- 
a the determination by the Legislature that merit and fitness 
! 


i| can only be demonstrated by examinations that have been proven 
i| 


|| supervisory positions which is presently planned or scheduled 


iH 


|| Valid. Thus every Board of Examiners testing procedure for 
, suc 
as that for elementary school principal, is in dereliction of 


|| said §2569(1). 

1 28. Section 2573(10) of the New York Education Law states 
| 

{ 


| -_- + The board of education, on the recommendation 
| of the superintendent of schools [Chancellor] shall 
designate, subject to the other provisions of this 
chapter, the kind of grades of licenses which shall 
be required for service ag Principal... principal, 
branch principal, director, assistant examiner in 
the board of examiners, supervisor or teacher of 
@ special branch, head of department, assistant, 
- + together with the academic and professional 


qualifications required for each kind and grade of 
license ... 


The Board c. Examiners, on the other hand, has no statutory 

| 

‘authority to establish academic or professional qualifications 
foe any license. Nevertheless, upon information and belief, the 


; Board of Education has in the past and plans to continue a prac- 


Examiners the perparation, administration and grading of super- 
visory examinations, including the proposed forthcoming examinatio 
procedure for the position of elementary school principal, to- 

gether with the determination of the appropriate academic and 


professional level of the content of said examination. The 


es tisseeseiseatepcoerieaaeiestei thailand 


| 
tico of lonving to tho exclusive discretion of the Board of 


result of this total deference by the Board of Education to tho 


Board of Examiners is that the latter body effectively establishes 


| 
| 


en 
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tr.z level and quality of academic and professional qualifications 


which are required to obtain the license of elementary school 


| principal. The Board of Exayiners is the sole determinant of 


the academic knowledge and professional abilities which a candi~ 


date must possess for successful completion of the testing pro- 


| cedure. The administration of any examination procedure for 


the position of principal in which the Board of Educution does 


not specifically instruct the Board of Examiners as to the parti- 


cular academic and professional qualities it is to test for, is 


an unlawful delegation of authority in violation ef said §2573 (10) 


WHEREFORE, plaintiffs respectfully pray: 


(a) 


(b) 


that this Court declare that defendant Board 
of Examiners’ present and planned use of 
supervisory examination procedures is in vio- 
lation of the Fourteenth Amendment of the Con- 
stitution of the United States and under the 
doctrine of pendent jurisdiction, declare the 
same in violation of §§2569(1), 2590-4 3(a) (1) 
and 2573(10) of the New York Education Law, 
and of Article V §6 of the New York State 
Constitution; 

that defendants and their successors be pre- 
liminarily and permanently restrained and 
onjoined from administering or otherwise 
making use of any written and/or oral test, 

ao a critorion for tho granting or withholding 
of the New York City license of elementary 


school principal or of any ohter New York City 


public school system suporvisory license, which 


(c) 


(d) 


(e) 


(f) 
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has not been prepared and validated in accord- 
ance with the latest standards of professional 
psychological testing as accurately measuring 
the merit and fitness of candidates to perform 
the tasks of the position for which the test~- 
ing is being administered; 

thet defendants and their successors be further 
preliminarily and permanently enjoined from 
administering or making use of any examination 
for principal, or other supervisory positions 
covered by N.Y. Educ. Law § 2573(10), which has 
not been prepared in accordance with, which does 
not strictly adhere to, and which in any way 
exceeds specific academic and professional 
standards for the license established by the 
Board of Education pursuant to said §2573(10); 
that this Court retain jurisdiction in the action 
until such time as defendants comply with the 
constitutione and statutes cited herein; 

that this Court award plaintiffe their costs 
and attorneys‘: fees; and 

that this Court grant such other and further 


relief as may be proper. 


Respectfully submitted, 


> 


JACK GREENBERG 
JONATHAN SHAPIRO 
ELIZABETH B. DUBOIS 
STEPHEN G. YOUNG 
10 Columbus Circle 
New York, New York 10019 


* 


GEORGE COOPER 
435 West 116th Street 
New York, New York 10027 


attorneys for Plaintiffs 
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Affidavit in Support cf Motion of Richard S. Barrett 
verified and submitted on May 28, 1971 


avin 
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BAR 
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certain opinions reyarding the supervisory examinations and 


' examination procedures of the Board of Examiners. 


. 


3. On the dsasis of the materials I examined for purposes 


| of ny two previous affidavits one cannot conclude that the 


supervisory examinations conducted by the Roard c*~ Examiners 


possess either content or predictive validity--that is, that the 


' content of the examinations is truly a sample of the work 


performed on the job or that the examinations actually select 


the better performers. In addition to the comments contained 


| in my previous affidavits, I note the following: 


4. Dr. Rockawitz' claim for the validity of supervisory 
examinations was based primarily on a number of alleged research 
and validity studies which were not submitted with his affidavit, 
Thus in his chief affidavit paras. 16 and 17 he states that the 
Booxd of Examiners has-conducted numerous research studies which 
were designed to determine and which confirmed the validity of 
the Board's examinations. Further, in his second affidavit, 
attached as Exhibit 5 to his chicf affidavit, he claims that 
there have been at least three empirical validity studies of 
examinations (para. 8) and that their results “indicate sub- 
stantial positive correlations between the purposes of the 
exeninations involved and the results obtained by the procedures 


of the Board of Examiners" (para. 9). Specifically, he relies 


examinations as showing that principals identified by their 
supervisors es having best implemented an educational program 
scored higher cn the examinations than a randomly selected group 
Of yrincipals (para. 10). Ana finally he alleges that the 


Hoare of Examiners’ satisfaction of its statutory duty to review 


ty, : 
on the results tf a validity study of elementary school principals 


| 
| 
| 


| 
| 
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reliability and validity is shown by 22 separate studies and by 
three volumes relaving to research performed by the Board of 
Emaminers (paras. 12 and 13). 

5. Dr. Rockawitz' claim for validity was also based on the 
epinions of the four experts whose affidavits were submitted as 
Exhibits 2a, 25, 2¢ and 2d to his chief wetidevsk* 

6. Examination of these experts' affidavits reveals that 
none of them claims to have conducted a study which would 
make possible a conclusion that the Board of Examiners’ exami- 
nations and esenisarion procedures possessed either content or 
predictive validity. And, indeed, these experts draw no such 
conclusion. Rather, the most that they claim is that on the 
basis of statements made to them by Board of Examiners’ | 
representatives and orc documents submitted to then it appears 
that. the Board of Examiners attempts to design content-valid 
tests. They make no claim that the Board of Examiners had 


; 3 
established the predictive validity of its examinations. Nor 


do they claim that the examinations possess content validity. 
Indeed, it is clear from their affidavits that these experts did 
not conduct“the kind of analyses which could support a claim of 
content validity. Thus they did not, for example, conduct a 
thorough analysis of the various different supervisory jobs at 
issue, establish definitions of good and poor performance, and 


determine whether the tests at issue adequately represented the 


af See para. 1( to Dr. Rockawitz' second affidavit, filed as 


acai ett et CC 
--_-— — <n © 


_ 


{ 
| 


Exhibit 5 to chief affidavit: see para. 14 of his chief affidavit. 


2af/ ind apparent), in 2 cases, of some prior experience with the Boarc. ; 
3/ they refer only to the one pilot predictive validity aca 
filed herewith as Exhibit 1, and discussed infra at para. 

and they do not hee that it supports the predictive vaiagiey 

of the hoard's supervisory examinations. 


a 
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mort important aspects of the related jobs Instead tlicy 


primarily 
apprrentiv based their opinions/on statements made to them by 


the #oard of Examiners’ representatives describing examinations 
ana examination procedures and on the research studics cited by 
Dr. Rockauwitz together with other documents submitted to them by 
the Rozrd of Examiners. Their conclusions were necessarily 
limited by the nature of their investigation. Since they did 
not perform a content arnrAlysis thev did not and could not claim 
content validity on the basis of *teir own investigation. They 
coulé and did claim only that on the basis of what they had been 
told and shown tho Board of Examiners appeared to have made 
certain efforts *o design content-valid examinations. 

7. %I have sow examined all the research studies and reports 
referred to and relied on by Dr. Rockawitz and the Board of 


ra 


Examiners' experts in their respective affidavits (hereinafter 


referred to as "research reports"). I have also examined the 
list of documents which were submitted to the four experts whose 
affidavits were filed on behalf of the Board of Examiners, in 
addition to examining the documents named thevdda. These =e 
and documents were provided me by counse2. for plai ntiffs, 
identified as all the documents produccd in response to Plain- 
tiffa' Request tor Production of Documents, filed March 24, 1971. 


5 
They are filed herewith as Exhibits 1-10 to this affidrvit. 


8. - I concluded from my examination of each of the ‘res7arch 


reports referred to in para. 7 above that: 


4/ For a description of the kind of analysis necessary to 
support a claim of content validity sce generally my second 

affidavit pp. 6-8. See also Standards for Edvcational and 

Pswchological Tosts and Manuals (American Psychological Assoc. 


1966) pp. l2-13, 15-16. 


i 2/  Roference is made with respect to cach exhibit to tho 
Yelovant’ paragraph of Plaintif{s' Request for Production. 


The only documents produced by Defendant Board of Examiners 
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(a) No study suppurted a claim of pre-~ 
Gictive validity. 


(b) Ne study constituted a content analysis 
or related to a claim of content validity. 


9. The only study relating to validity is that entitled 


of Examination for Principal of Rlementary Schools which 


appears as Exhibit 1 (produced in response to Request l(e)). It 


is subject to numerous methodological flaws. But even assuming | 
the study had been properly designed it would not support a on 
that the examinations in question were related to job performance | 
It indicates, rather, that no such relationship exists. 

| In this seven-page salf-styled "pilot study" (p. 1), 57 
principals were nominated by their supervisors for the experi- 
mental group as having "best implemented an educational program 
in their schools" (p. 2). No analysis of the position is reporte 
but it seems that implementing an educational program is an | 
important part. but only a part, of tho principal's duties. No 
information is given as to the basis on which selections were 


made or the reliability of the selections. 


S/ Continued 
that have not been filed as Exhibits are the following: 


(1) Item analyses produced in response to Request l(g). 

: These are computer run-offs, unintelligible without 
further analysis and explanation and enormously bulky. 
They are irrelevant to the issue of validity, as is 
revealed in the Appendix hereto, p. 3a , infra, 


(2) The written part of the cxamination for Assistant 
Principal, Junior High School 1968, produced in 
response to Request 7. This was previously filed by 
Plaintiffs as Iishibit 1 to Affidavit of Llizabeth B. 
DuBois filed Noveber 6, 1970. 


(3) The written part of the examination for Principal, Day 
4 Elementary School 1964 and related dutics, produced in j 
response to Request 7. This was previsusly filed by 
Defendant Boara of Examiners as Exhibit 4b to Dr. 
Rockewitz' affidavit filed October 27, 1970. 


G/, Only those supervisors who wished to participate did; what- | 
cver number of names (from 2 to 5) they sent in were accepted 
for the experimental group. 


. 


160a_ 


Comparisons were made between the scores of these 57 
principals and a control group of 111 randomly solectac. eh cis as 
or Bix different tests taken from January 11, 1946 to March 17, 
1966. There is no discussion of the tests, so it is impossible 


to know from the report whether the nature of the tests was con- 


stant over the 20 ycar period or whether they are like the test 
for this position administered in 1970-71. 

No conclusions can be drawn from Yable 3, which presents 
“the mean rank order of examination scores .. .," since averaging 


ranks is a vronibited arithmetic operation. 


tests. In four cases the experimental group had higher average 


° 


scores than the control; in two it had lower scores. Two of the 


cases wre the experimental group had higher scores were found to 


Table 4 compares the means of the raw scores on the = 


be statistically. significant, but the report itself notes that: | 

"Although statistically significant dif- 

ferences were reached for these two ‘years, 

the relatively small population of the a 

samples involved should be noted.“ (p. 6) 
Where the numbers of candidates torggach test were larger, the 
differences between experimental and control groups were small, 
ranging from 1.84 to -.48 points on examinations in which the 
average scores were in the low seventies. Therefore, analysis 
of the results of the different tests, cannot support ary conclu- 
sion that the experimental group perforred better on these tests 
as a whole than the control group. 

The study attempted to analyze the aggregate test data by 

converting the scores on each examination to standard scores and 


enemies 2 eee 


i/ These twe examinations involved only 7 out of the 57 members | 
of the émporimental qroup; and only 16 ovt of 111 memhers of tre 
wontrol grovp, or less than 14% of the total candidates. 
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comparing these for all examinations combined. The results are 
contained in Tuble 5. While again theca results aro flawud hy 


improper methodology, the report itself concedes: "The dif- 


ference between the means did not, however, reach significant 


levels" (p. G). Indeed, the difference is so small (50.393 for 
the enperimental group; 48.57 for the control group) as to 
indicate that even if these scores represent the true difference 
between the two groups the examinations failed to distinguish 
in a useful way betweenthose who would be good performers (as 
defined by the study) and those who would not. 

In the conclusion, despite the statement quoted above, the 


Feport statcs: 


e 
ff 


The’ data indicate that elementary school’ 

principals who were identified as having 

best implemented an educational program in 

their schools score higher on the Board of 

Examiners license examinations than do a 

randomly sclected group of clementary 

principals [p. 7). 
The data do not suppdrt this conclusion. Instead the data pre- 
i sented ‘ndicate that there is no significant difference in the 
scores of the two groups. 

10. The remaining research studies submitted by the Board of 
Examiners deal with the internal structure of the tests and are 
not concerned with validity. At best they indicate that the 
Peard has made a limited study of the reliability of some of its 
procedures. Other reports cited by Dr. Rockowitz a: research 
studies consist simply of a research proposal t2 develop a jo» 
analysis for the position ef Elementary Schcol Principal, “de? 
ticns of tcacker selection procedures jn various school systems 
in the United Stutes, and a report on a conference held by the 


Yoard of Examiners on teacher selection procedures. Brief 


descriptions of each of these documents are contained in the ° 
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7 hEpeeee™ harete, infra pp. la-6a . The documents themselves are 

| filed herewith as Exhibits 2 - 8. 

nd 1 ll. I also examined the documents submitted to the four 

| experts whose affidavits were filed by the Board of Examiners in 
order to evaluate the Board's claim for content validity of the 

| supervisory examinations. 


12. ‘Ihe list of all documents submitted to said experts, 


as a basis for their affidavits, appears as Exhibit 9. Some 


analyzed in the Appendix hereto are included on this list. . They 


appear as separate Exhibits. The remainder ere contained in 


——— 


| of the research reports discussed in paras. 8-10 above and 


Exhibit 10, identified by the “ee, numbers by which each is 
8 


designated on the Exhibit 9 list. 
13. Some of the documents listed in Exhibit 9:indicate that 

. the Board of Examiners has taken precautions to assure that both 

the objectively. and subjectively scored portions of the written 

examination are graded with the identity of the test taker 

adequatcly concealed. There is no indication that a special 

effort has been made to eliminate or minimize the effects of ~ 
ethnic prejudice in the interview test, or other procedures in . 
|which the identity of the candidate is known. 


14. None of’ the documents listed in Exhibit 9 can support 


a claim for content validity, in the absence of the sort of 


| thorough investigation described in para. 6 above and pp. 6-8 of 
| my second affidavit. Included in Exhibit 10 are statements of 
the "Duties of the position” and the written tests for a few of 

| the supervisory positions in the New York City school system. 

But no conclusion as to validity can be drawn from simply looking 
| at these documents. A detailed study of the job dutice and a 


Items No. 14 and 19 are omitted from Exhibit 11 since, 45 
noted supra n. 5, they were filed previously. : 


= ao 


— 
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| legical comparison of: these duties with the test is required. 
“ne inadequacies of the docunents entitled "Duties of the Posi- 
tion" have heen discussed in para. 2 of my second affidavit. 
These aro administratively oriented descriptions, not the kind of 
detailed analysis of the position in terns relevant to the 
| &election procedure that is essential to any attempt to establish 
validity. na research proposal filed herewith as Exhibit 7 
|wakes clear the need to develop a job analysis for the position 
of Elementary School Principal and that no such analysis has 
over previcunly heen performed. 
15. As noted in my previous affidavits, it is both reason- 
able and dcsirable to demand that examinations” for positions of 
i the level of surervisor in a major school system be shown to be 
related to job performance even though it is more difficult to 
-establish success criteria for such a position than for positions 
involving primarily mechanical skills such as that of a typist or 
| factory worker. The experience of many organizations shows that 
' validated tests improve the quality of the work force in higher 
level positions such as business executive, life insurance agent, 
or psychiatrist. The Board of Examiners has clearly had an 
opportunity to develop modern, valid selection procedures. The 
tests and the research studies that I have examined are clearly 
inadequate to the task of selecting the better candidates for 
supervisory positions in the New York City school system. 

That validation of tests of this nature is feasible is 
illustrated by the fact that many organizations have devoloped 
valid predictors regarding success on a wide varicty of executive 

| positions. And the Board of Examiners has itself recognized the 

| neea for and fwasibility of devaloping proper jols analyses and 

success criteria and fer validating their procedures. ‘This is 
sllustrated by the report of the conference on tercther select: 


methods, which appears as Exhibit 6c ard is summarized in thc 


Appendix hereto, Pp. 5a - At that conference, experts 


lé4a 


voce ly the Roard of Examiners, as well as Bourd representa-~ 
| ** ves, testified to the need for and feasibility of developing 
| success criteria and validation techniques in the area of teacher 
Is selection and such recomnendations were aéopted in the rer 's 
| cht In addition, the Board's own research proposal for 
lene Gevelopment of a job analysis for the position of Elementary 


School Principal (para. 14 above, Exhibit 7; Appendix p. 3a) 


‘a 


windicater its belief that success criteria can be defined in this 


area. And finally, the Board's pilot predictive validity study 


jj (Exhibit 1; para. 9 above) shows that jt believes it is feasible 


| t design studies to determine whether its tests are successful 


lin selecting the better performers. 


‘HARD S,. BARRETT 


Subscrizved and sworn to before 


me this 28th day of May, 1971. 


= fAiusat ® £6 Fe Lane °O 


: i 77 
fo mpg Mes eae 
Pea fo) Se a [is- é 


Notary Publis / 
ANN W AG FR 
Petary Pustie. fare -1 Hew York 
Le) 265% a0 3 
ic Qurti"ied in nee No : County 
| 
| 
| 


wmiation Eapives Uaich 39, 1972 


165 


Affidavit in Opposition to Motion of 
Murray Rockowitz verified and 
submitted on June 4, 1971 
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| UNITED STATES DISTRICT COURT 
SOUTHERN DISTRICT OF NEW YORK 


BOSTON M. CHANCE AND LOUIS ¢., 
MERCADO, et al., 


ee 


Plaintiffs, 


: REPLY AFFIDAVIT 
-against-— 


THE BOARD OF EXAMINERS AND THE 
BOARD OF EDUCATION OF THE CITY : 70 Civ. 4141 
OF NEW YORK, et al., 


Defendants. 


| STATE OF NEW YORK ) 
H : e8.: 
| COUNTY OF KINGS) 


Dr. Murray Rockowitz, being duly sworn, deposes 


, 


S 
ie ET am 4 member of the Board of Examiners and 


and says: ' 


have primary responsibility for research and development. 
2. I submitted a prior affidavit verified on 

October 26, 1970 in opposition to plaintiffs' motion for 

ja preliminary injunction. The present affidavit is sub- 

| wtttes in reply to the third affidavit of Richard S. Barrett 
verified on May 28, 1971. 

| 3. It is the position of the Board of Examiners 

| that the pass-faii statistics on the 50 examinations sur- 

' veyed as illuminated by expert analysis do not show suffi- 

j ciently Substantial differences between the performance of 

| ethnic GBroupings to raise an inference that the examination 

} System may have a discriminatory impact upon blacks or 

| Puerto Ricans, Accordingly, defendant believes that the 


Plaintiffs have not shown and could not show any possible 


oP ERE EEE ERS 


| 


| 


f 


i 
| 
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invasion of their Constitutional rights and the Complaint 
should be dismissed. 

4, It 4s also the contention of the Board of 
Examiners that under applicable Constitutional law, plain- 
tiffs must not only properly allege and show a disorimina- 
tory impact but must properly allege and prove that the 
Supervisory examinations do not bear &@ rational relationship 
to the legislative Purpose of providing &@ pool of qualified 
personnel from which local school boards may select indi- 
viduals suitable to the particular needs of their respective 
communities. On the other hand, plaintiffs claim that this 
burden rests on the defendants not the Plaintiffs. Regard- 
less of whoever has the burden of proof, it ts abundantly 
Clear that the overwhelming evidence before the Court re- 
garding the matter of Job-relatedness demonstrates that the 
Supervisory examinations are in fact job-related. I refer 
to the affidavit of Gertrude Unser verified on October 26, 


1970 and to my previous affidavit of the same date, which 


| affidavits outline the fundamental testing procedures em- 


Ployed by the Board of Examiners, and I refer also to the 
affidavits o* Dr. Robert L. Thorndike, Dr. Marvin Sontag, 
Dr. Aaron Suss Carton and Dr. Esin Kaya Carton (all attached 
as exhibits to my previous affidavit), a@ll of whom are ex- 
perts in the field of educational testing and have reviewed 
the Board's examination procedures for purposes of this 
litigation. 

>. Dr. Barrett's latest affidavit is the first 
testimonial proof offered by plaintiffs which seriously 
purports to bear on the question of the Job-relatedness of 


defendant's examinations. However, Dr. Barrett does not 


attacking various research studies conducted by the Board's 
staff in recent years and has the temerity to discount the 
opinions of the four educational testing experts who care- 
fully reviewed the testing procedures of the Board of Ex- 
aminers and offered their judgments in the aforementioned 
affidavits, this from an individual whose experience appears 
to be primarily in the field of industrial psychology. 

6. Dr. Barrett's affidavit is replete with 
simplistic conclusory statements based on assumptions which 
he does not prove, criteria which he does not document, and 
Judgments which are not borne out by facts. An exhaustive 


rebuttal would scrve no useful purpose in relation to the 
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: even now meet the issue head on. Instead he resorts to 
| 


issues before the Court since Dr. Barrett does not deal 
 batpeetiy with those issues. Accordingly, I shall limit my 
reply to exemples of the foregoing points concerning Dr, 
Barrett's analysis. 

7. In paragraph 4 of Dr. Barrett's affidavit, he 
States: "Dr. Rockawitz' (sic) claim for the validity of 
Supervisory examinations was based primarily on a number 
of alleged research and validity studies. ..." This is 
sheer nonsense. Our claim for the validity and job- 
relatedness of these examinations rests largely on the 
thoroughly professional test construction techniques employed 
by the Board of Examiners which have been explained fully in 
earlier affidavits. We also asked the above-mentioned noted 


, educational testing experts to review and evaluate our exam- 


— 


y Lnation procedures and give their opinions of the objec- 


== ee 


j tivity, reliability and validity of those procedures; Their 


seine siamo 


| Judgments were uniformly favorable. Finally, we rely on 
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continuing research done by the Board's staff. However, 
that research is not done to meet Dr. Barrett's abstract and 


unrealistic standards, nor is it done in contemplation of 


litigation; it is performed by professionals to make prac- 


tical recommendations on ways to improve testing technioues. 
8. In paragraph 6 of his affidavit, Dr. Barrett 
cavalierly charges that none of the four distinguished 
experts who furnished affidavits “conducted a study which 
would make possible a conclusion that the Board of Examiners 
examinations and examination procedures possessed either 
content or predictive validity". Dr. Barrett evidently 
assumes that no expert can form a judgment concerning the 
validity of examinations unless he replicates the entire 
test construction procedure personally. It 111 behooves 
Dr. Barrett to make this statement considering the opinions 
which he offered in his first affidavit on the basis of 
meager analysis and much speculation. But beyond this, his 
thesis that one cannot form a judgment concerning validity 
unless one actually conducts “he test is plainly contradicte 
. both by common sense and by the literature in the field. As 
Dr. Lee J. Cronbach (one of the leading experts who along 
with Dr. Robert Thorndike plaintiffs cited for authority in 
their first brief) points out: "Content validity is estab- 
lished by logical examination of the test and the method 
used in its preparation." Lee J. Cronbach, Essentials of 
Psychological Testing, Harper & Bros., 1960, p. 364. "Ifa 
test is prepared according to a clearly described sampling 
plan, the user can judge content validity very simply. He 


needs only to decide whether he is satisfied with the test 
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9. Dr. Barrett next observes that the four ex- 
perts “apparently based their opinions primarily on state- 
|ments made to them by the Board of Examiners' representative 
describing examinations and exam!nation procedures and on 
the research studies cited by Dr. Rockawitz (sic) together 
with other documents submitted to them by the Board of Ex- 
aminers" (Barrett 3rd Affidavit, p.4). Again, Dr. Barrett 
makes erroneous assumptions to fit his predetermined con- 
clusions. Indeed, in the very next paragraph of his 
)} affidavit, Dr. Barrett refutes his prior assumption. The 
j experts relied primarily on examination of a host of docu- 
| ments, many included at their own request, illuminating the 
test construction and grading techniques employed by the 
| Board of Examiners. Oral explanation was also provided when 
| requested. These distinguished experts knew precisely what 
| documentation and other information would be necesgeary to 
| make an informed judgment under the circums inces. 
10. Dr. Barrett says that "no conclusion as to 
| validity can be drawn from simpiy locking at these documents 
i [the documents ‘reviewed by the four educationel testing ex- 
| perts]" (Barrett 3rd Affidavit, p.8). Of course not. It 
| takes more than "simply looking"--it takes thought and 
} evaluation. As Dr. Robert L. Thorndike observed in his 
| affidavit: 
"The closeness of match between the tasks as 
set forth in the examination ani the duties 
of the job as set forth by the supervisory 
personnel in the city system can be evaluated 
only by informed judgment, not by statistics 


or manipulation of numbers. It is a Judgment 
arrived at by examining the statement of 


. 
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requirements and by looking carefully at the 

questions together with the procedures set up 

for evaluating answers to those questions. 

In general, the Board of Examiners appears 

to have made a conscientious and informed 

attempt to develop test tasks that--d6 

correspond to selected ones of the specifica- 

tions set forth by the supervisory persons 

who set out ‘he réquirements for the job." 

The "specifications" referred to by Dr. Thorndike are the 
“Duties of the Position" prepared by experts designated by 
the Chancellor. Notwithstanding Dr. Barrett's protestations 
to the contrary, none of the educational testing experts 
found these specifications insufficiently detailed. More- 
over, as I have previously stated in my earlier affidavit, 
the procedure which Dr. Barrett requires--namely, "a detailed 
Study of the job duties and a logical comparison of these 
duties with the test" (Barrett 3rd Affidavit, pp. 8--9)--4s 
one which has been uniformly followed by the Board of Exam- 
iners in test construction. 

ll. Concerning the actual opinions offered by the 
four experts, Dr. Barrett states that none of the experts 
"claim that the examinations possess content validity" 
(Barrett 3rd Affidavit, p.3). The exnerts have testified 
that the examinations are content valid in the accepted 
sense of the term. As Dr. Lee J. Cronbach said in the 
authoritative 1971 publication of the American Council on 
Education entitled Educational Measurement: 

" "Content validity is impermanent. The items 

or tasks in the test reflect social events, 

Job descriptions, accepted beliefs about che 

world, decisions about what the curriculum 

should cover, etc." (p. 457) 

Dr. Barrett speaks of content validity as if it were some 
fixed and immutable standard about which categorical state- 


monts are quite appropriate. Again, both common sense and 
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the literature reject this notion: "It ds nonsenas to trik 


about validity in the abstract. The validity or a test is 


alwe’s with reference to some particular variable and not 


variables in 


general." Allen L, Ldwards, Statistical 


Methods for the Behavioral Sciences, Holt, Rinehart & 


Winston, 1962, p. 179. 


being matters of degree, the stated opinions of these four 


distinguishe: 


~ @xports firmly support the rational and pro» 


fessional character of the examination procedures employed 


by the Board 


useful to contrast the categorical statem_ats of Dr. 


of Examiners. In this vconte-t, it might be 


with the responsible evaluations of these four ervrrts. 


Dr. Robert L. Thorndike stated: 


"In general, the Board of Examiners appears 


to 


bave made a conscientious and informed 


arte 2t to develop test tasks that do 
correspond to selected ones of the specifica- 
tions set forth by the supervisory persons 
who s«+ out the requirements for the job. 


Obviously, it 1s possible in anv limited 
period of time to test only some of the 
requirements even if 211 of them could be 
reduced to a paper-anc=pencil test or to an 
interview situation. Necessarily, any test 
represents a sampling of Job duties and 
represents a sampling from among those that 
can be reduced to a paper-and-pencil or 
interview testing situation. Within these 
limits, the tasks that are represented in 
the test items appear to me to be reasonable 
tasks as representing selected ones of the 
job requirements." 


_Dr. Marvin Sontag stated: 


Judgments concerning content validit 


Barrett 


"In determining the skills to be measured 

and in preparing the test items, the Board 

of Examiners routinely consults panels com= 
posed of both persons holding the particular 
Jobs ard university professors with expertise 
in the pertinent areas. Thus, @ conscientious 
attempt is made to combine both Practical and 
theoretical viewpoints. This thinking is kept 
current by employing a new panel each time an 
examination is offered. While no one can argue 


/ 
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that the products are always perfect, this 
approach is all that can be hoped for in 
such a situation. It represents an honest 
attempt to achieve relevance and validity, 
and it allows the examination to reflect 
changes in thinking regarding the nature 
of a particular job." 


Dr. Aaron Carton stated: 


"The approach used by the Board of Examiners 
in determining the validity or relevance of 

its tests consists essentially of a strategy 
which relies on the judgments of experts and 
consensus among them as to what constitutes 

an appropriate test item." 


ag 


Finally, Dr. Esin Carton stated: 


"The procedures used to establish the 
validity of the tests indicate that the 
items selected for the examination repre- 
sent an attempt to simulate the events can- 
didates would encounter on the job. There 
are different techniques for either assuring 
or studying the relevance of the test to the 
requirements of the Job. The technique used 
by the Board, namely establishing content-— 
validity, attempts to assure the relevance 
of the items on the test to job criteria 


eszablished by the professionals in the 
field." 


12. In paragraph 9 of his affidavit, Dr. Barrett 


seeks to attack a Board of Examiners' research study-- 
acknowledged to be a Pilot study--concerned with predictive 
validity. His analysis is an exercise in nit-picking. For 
example, he challenges the criterion employed, making the 
incredible etatenent that "implementing an educational pro- 
Gram is an important part, but only a part, of the prin- 

i Cipal's duties". One wonders what criterion Dr. Barrett 

j Would use in a pilot study involving the position of 

| elementary school principal. The Board of Examiners went to 
j the person most closely aware of the Quality of the work 

| being performed by the Pprincipal--his immediate supervisor, 

| the District (Community ) Superintendent. ‘To whom would Dr. | 


} Barrett ask us to go instead? 


} 
} 
t 
+ 


t 
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13. Any researcher worth his salt would admit 


that few studies can claim to be all-inclusive and complete 
free of procedural flaws. Dr. Barrett faults us for acknowl 
edging these. For example, we cannot he expected to involve 
in a study people who fail the examination because they did 
not have the opportunity to serve as principals. Would he 


counsel sending 1,000 unlicensed pilots into the air, allow 


300 of them to crash, and then conduct a differential study 
of che examination they took 30 that we can determine whethe 
the test had predictive validity? No, the Board of Examiner 
does not claim th the study is conclusive. Indeed, the 
discussion of the exploratory study as reported contains 
this guarded but honest evaluation. "This pilot study deals 
with a highly select group of successful candidates and a 
less-than-perfect criterion measure. In spite of these 
limitations, the empirical evidence 4s supportive of the 
selection procedures utilized." 

14. Dr. Barrett 4s also guilty of overreaching 
and plain error in many of the "nits" he "picks". For , 
example, he states that "only those supervisors who wished 
to participate did" (Barrett 3rd Affidavit, p.5, n.6). The 
report indicates that 28 of 30 superintendents participated. 
He further questions whether "the nature of the tests » 
constant over the 20-year period" (Barrett 3rd Affidavit, 
p.6). The obvious answer 1is--of course not. One would not 
expect the examination to remain the same since the role of 
the principal has changed over the 20 years and will con- 
tinue to change in the future. This is a basic problem 
with predictive validity studies of educational supervisory 


positions. Barrett goes on to state that "averaging ranks 


|) Supra, pp. 104-06.# 
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is a prohibited arithmetic operation" Ibid. This assertion 


is contradicted by the literature in the field. See Edwards 


Statistical Methods for the Behavioral Sciences, Holt, 
Rinehart and Winston, 1962, p. 41c. Barrett also finds 
fault with the analysis of "aggregate test data by convertin 
the scores on each examination to standard scores and compar 
ing these for all examinations combined." Ibid. Again he 


is contradicted by the literature. See Edwards, op. cit. 


* Dr. Barrett continues his exercise in nit-picking in the 
Appendix to his affidavit which is entitled "Analysis of 
Research Reports", His analysis largely consists of search- 
ing for flaws in research reports prepared by the Board's 
Staff. Again he is frequently in error. For example, in th 
first report "analyzed" (marked "Exhibit 2") Dr. Barrett 
notes that 11 of the 27 assistant examiners questioned had n 
previous experience, observing that "their opinions on four 
of the questions are tabulated along with those of experi- 
enced examiners" (Barrett 3rd Affidavit, p. la). If Dr. 
Barrett had taken the time to read the text of the report, 
he would have found a breakdown of the opinions of experi- 
enced and inexperienced assistant examiners on all of the 
questions. Noteworthy, too, is Dr. Barrett's failure to 
submit the 13 item analyses performed by the Board's staff. 
He comments that these are "unintelligible without further 
analysis and explanation and enormously bulky" (Barrett 
Affidavit, p.5, n.5). ‘These should not be "unintelligible" 
to an educational testing expert. Moreover, his further 
observation that these item analyses are irrelevant to the 
issue of validity is contradicted by the literature. Dr. 
Thorndike points out that, "the effectiveness of a test 
depends on the characteristics of the items which compose it. 
In both its reliability and its validity a test score is the 
resultant of the validities, reliabilities, and intercorrela 
tions of its component items". Thorndike, Personnel Selec- 
tion: Test and Measurement Techniques, John Wiley & Sons, . 
1949, p. 227. He goes on to say that, “as soon as the 
validity is determined for each item, we are in effect treat 
ing each item as a separate test. It is as if we had the . 


validity coefficients for a very large number of very brief 
tests". Id. at 244, 
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15. Shifting from the matter of validity to the 
|matter of objectivity, Dr. Barrett reluctantly acknowledges 
| that there is evidence that "the Board of Examiners has 
| taken precautions to assure that both the objectively and 
| subjectively scored portions of the written examination are 
| graded with the identity of the test taker adequately con- 
cealed" (Barrett 3rd Affidavit, p.8). He goes on to state, 
i however, that "there is no indication that a special effort 
i has been made to eliminate or minimize the effects of ethnic 
prejudice in the interview test, or other procedures in 
which the identity of the candidate is known" (emphasis 
added). Ibid. Quite so. It has been the policy of the 
Board of Examiners throughout its history to make no 
"special effort" on behalf of any group. Both sound test- 
ing procedures and the Board's legislative mandate command 


this approach. The Board's examination procedures which 


| 
| 
| 
| 
| 
| 
| 


have been previously outlined in our papers are designed to 
minimize subjectivity in all interview tests regardless of 
ithe external characteristics of any applicant, among them 
| race, religion, national origin, age or sex. Is Dr. Barrett 
suggesting that sound testing procedures should provide 
special treatment for special groups? 
16. Permeating Dr. Barrett's entire affidavit is 
his contention that predictive validity studies are both 
i feasible and necessary to support the Board's examination 
| procedures. Dr. Barrett is notably behind the times in his 
| knowledge of the field of educational testing. Again, we 
can quote from the comments of Dr. Lee J. Cronbach in the 


( latest authoritative text in the field: 
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"The theory of prediction was very nearly 

the whole of validity theory until about 1950; 

in the last two decades testers have given 

increasing attention to descriptive and ex- 

planatory interpretations and have relegated 

prediction theory to a secondary position." 

Educational Measurement, Op. cit. supra, p. 443. 

17. Concerning the feasibllity of predictive 
validity, Dr. Barrett makes the following statement: "The 
experience of many organizations shows that validated tests 
improve the quality of the work force in higher level posie 
tions such as business executive, life insurance agent or 
psychiatrist" (Barrett 3rd Affidavit, p.9). There is a 
notable absence of supportive citation. By contrast, Edu- 
cational Testing Service, the largest educational testing 
institution in the country, has said of its National Teacher 
Examinations: 

"Because no claim is made that NTE scores 

predict ‘teaching effectiveness,' there has 


been no attempt to present data relating NTE 
scores to this global criterion." Educational 


Testing Service, NTE Prospectus For School and 

College Officials, 1970, pbs 

18. Finally, with a "have your cake and eat it 
too" attitude, Dr. Barrett reaches into the Board's own 
research reports and proposals to support his claim as to 
the feasibility of predictive validity studies of examina~ 
tions for supervisory positions. Dr. Barrett cites comments 
of experts reported in Teacher Selection Methods published 
by the Board of Skantoors in 1967. What was said? Of his 
| proposal for predictive validity studies for teacher selec- 
tion procedures, Dr. Harold &. Mitzel, Dean for Research at 


Pennsylvania State University, observed that "the proposal 


is deceptively simple, fantastically expensive, and 


politically difficult to bring about". Id. at 102. Lastly, 


| 1776 


| 
| Dr. Barrett points to the Board's own Federal research pro- 


posal and its pilot predictive validity study to support 


his assertion th2t the Board itself "believes it is feasible 
to design studies to determine whether its tests are success 


| ful in selecting the better performers" (Barrett 3rd 


Affidavit, p.10). For a supposed research expert to make 
1a Gtatemert of this kind ts ine omprehensible. For the Board 


Of Exariners to “all te pursue an important avenue of 


oe¢arch is an inquiry. 

| It may be undertaken on the basis of a belief, a neutral 

| Preconception or even a doubt. It is a search for knowledge 
19. In any event, Dr. Barrett's entire effort to 

manipulate the Board's research reports is a straw man 

device. The Board's research is part of an on-going effort 


to improve the objectivity, reliability and validity of its 


|) examinations. Insofar as the present litigation is con- 


y cerned, the jJob-relatedness of defendant's supervisory 


| examinations hs been established beyond peradventure of 


doubt 


| oe hea 
| 
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‘NITED STATES DISTRICT CoOuRT 


SOUTHERN DISTRICT OF NEW YORK 
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BOSTON M. CHANCE and LouIS c. . 


MERCADO, individually and on 
behalf of all others similarly 
situated, 
Fy 
Plaintiffs, 
, t 
~against- 


THE BOARD OF EXAMINERS AND THE 

BOARD OF EDUCATION OF THE CITY oF '? 
NEW YORK; GERTRUDE E. UNSER, 
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as Chairman of the Board of 
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ROCKAWITZ and PAUL DENN, indivi- 
dually and in their capacities as * 
members of the Board of Examinersy 
MURRY BERGTRAUM, individually and * 
in his capacity as President of 

the Board of Education: ISAIAH E. 
ROBINSON, JR., individually and 

in his capacity as Vice-president ' 
of the Board of Education; MARY EB, 
MEADE, SEYMOUR P. LACHMAN, and 4 
JOSEPH MONSERRAT, individually 

and in their capacities as 

members of the Board of Educa~ 

tion? HARVEY B. SCRIBNER, indivi- * 
Gually and in his capacity as 
Chancellor of the city School ‘ 
District of the City of Now york; 

and THEODORE H. LANG, individually ? 
and in his capacity as Deputy 
Superintendent of Schools of the ’ 
City of New york, 
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George Cooper, Esq. 
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MANSFIELD, Cs.” 
The fairness and validity of competitive examinations, 
once described by Gilbert and Sullivan as the means of attaining 


"a Duke's exalted station, "> have frequently been challenged in 


courts and elsewhere. E.g., Griggs v. Duke Power Company, 
U.S. 1 91S. Ct. 849 (1971); Louisiana v. united states, 380 


U.S. 145 (1965); Willner v. Committee on Character and Fitness, 


373 U.S. 96 (1963); Schware v. Board of Par Examiners of New 


! 


Hexico, 353 U.S. 232, 238-39 (1957); Armstead v. Starkville School! 


District, 3 BYA Lab. Rel. Reptr., FEP Cases 419 (N.D. Miss. 
April 7, 1971). We are here called upon to decide whether one | 
examinations which have been prescribed and administered by the 
Board of Examiners of the City of New York (the “Board” hebain’ 

‘to candidates seeking licenses for es appointment to 


supervisory positions in the City's school system (principals, 


assistant principals, administrative assistants, etc.) are 
unconstitutional. We conclude that a sufficient showing has 
been made of violation of the Equal Protection Clause of the 
Fourtcenth Amendment to warrant tho issuance of preliminary . 
injunctive peitak. 
Tha two nomed plaintiffs, who are sonnentivety Black 


and Puerto Rican, have brought this purported class action on 


« 


* Heard the case as a District Judge and, after appointment to 
the Circuit Court of Appeals, was dasignated to sit on ths 
District Court for tho purpose of completing this phase of 
tho case, a : 
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behalf of themselves and all other persons similarly situated 


pursuant to federal civil rights laws, 42 U.S.C. §§19817 and 


3 
1983. They allege that the competitive examinations, which 


must be passed by a candidate before he or she can qualify for 
licensing and appointment, discriminate against persons of Black 
and Puerto Rican race, and have not been validated or shown fairly 
to measure the skill, ability and fitness of applicants to perforn 
the duties of the positions for which the examinations are given, 
with the result that success on the examination does not tent 
in any way that the candidate will succeed as ‘ supervisor, This 
racial discriminatory ofisct, coupled with lack of justification 
ox predictive value 1 measurements of abilities required to 
perform the jobs involved, is alleved to violate not only 
plaintiffs' federal constitutional rights but also (based on 
pendent jurisdiction) Art. 5, §6 of the New York State 
Constitution,® and §§2590-3(3) (1).> 2569(1),© and 2573(10)7 of 
the New York Education Law. | | 

Plaintiffs seek a preliminary injunction under Rule 65, 
P.R.C.P., prohibiting the alleged violations of these laws. . They | 
also seek Seuhawatnes relief” pursuant to 28 U.S.C. §2201. We 
have jurisdiction under 25 U.S.C. §§1331 and 1343(3). 

The Board of Education has not actively opposed the 


motion for preliminary injunction, and it agrees that plaintiffs 


ohn 
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have presented triable issues of fact. Thé Board of Examiners 
("Board” herein), however, has vigorously opposed sin dubai, 

In reaching our decision we have had the benefit of 
a plethora of lengthy affidavits and exhibits, a hearing at 
which oral testimony was taken, a series of arguments, and | 
extensive briefing of the law and facts by the parties. In 
addition the following organizations have appeared ss amici end | 
filed briefs supporting plaintiffs: New Association of Black 
School Supervisors and Administrators,” ASPIRA of America, Inc.,>° 
1l 


and the Public Education Association. 


An applicant for permanent appointment to a eupervisory 
position in the New york city School system must, in addition to | 
meeting tate requirements for the position, obtain a New York | 
city license.)* First, each such candidate must have met | 
education and experience requirements established by the City's 
Board of Education and the Chancellor, Harvey B. Scribner, who 
4s the Chicf Administrator of the School District of the city of 
New York. For ‘ichasde. a candidate for weineival of a day | 
elementary school must, among other things, have had (1) four 
years’ experience teaching in day schools under regular license 


and appointment as a teacher, and (2) two years’ experience of 


supervision in day echools under license anda appointment, or meet 


various alternative expericnce requirements, 


ae 
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Next the candidate must pass an examination procedure 
prepaxrcd and administered by the Boaru for the particular type 


or classification of supervisory post desired, which may take ao 


| 
| 


' long as two years to complete. If the candidate succes fully 
completes the testing procedure, he or she is granted a Stesese 
and placed on a list of those eligible for assignment to the ma | 
of supe’ -y position involved. The appropriate school governin: 
authority -- either a central board of education or a community 
school board under New york City's prosent decentralized system -~ 
then selects the person it wishes from the eligible List to £411 
an open position. Since appointments of permanent supervisors 
personnel in the New york city School System must be made from 
lists of eligibles who have passed cxaininations, the Board from 
time to time eases and conducts examinations for perticular 
supervisory posts (of which there ara nore than 50 different types) 
following which the number of persona eligible for appointment 

are supplemented by promulgation of lists of those mo passec the 
latest cxamination. If a successful candgeate, after being Listed! 
as eligible for appointment, is not appointed within four years, 
he or she is dropped from the list and must again ane the 
qualifying examinations to be listed as eligible. 

Only in. the cities of Buffalo and Ne. York does tate 


law provide for cxaminaticns in addition to state certification, 


1 


RG 
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N.¥. Educ. Law §2573(10-a), and only the New York City School . 


District maintain. a Board of Examiners and the specific 
examination and licensing procedure here under attack, 1S 
Board has described itself as “a highly select gro’ “ ° xoad 
ee en education anc related fields chosen 
through the most objective and impartially searching examination 
given under civil service." (Ex. 10, Item i0, attached to 
5/28/71 aff. of Richard S. Barrett) ‘ 

Were it not fer New York City's special examination 
and licensing procedure, plaintiffs Chance and Mercado would have 
_ been appointed permanent Re aneneney school i lias isa pot wave 


been certified by the state for that sasktlon. and both are 


specially trained to be principals, having graduated Si a 
year-long Fordham University Instructional sais miata and 
Principals internship Progran in urban education, 

Plaintif£ Boston M. Chance has been ae ke the 
New York City public school system for the last 15 years and 
is acting principal of ».S. 104, an alements:7 echool in the 
Rronx, Chance, who 4s of the plack race, possesses all of the 
basic qualifications of education and experLence eetabiished dy 
daw and by the Beard of Education «id the Chancellor o the 


New ‘York city School District for the position of principal of 


an elementary school, However, he lacks a city licence as 
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elementary school principal and therefore is’ barred at present 
from securing a permanent position as principal. In September, 
1968, Chance took the examination given by the Board for the 
position of Assistant Principal, dunior High School, but he failed 
it and thus was not pleees on the eligibility list ad was = 
issued a license entitling him to permanent ainstebunnt: 

Plaintiff Louis Mercado, a Puerto Rican who also holds 
a New York State license as a principa’., has mage dein the 
Wew York City school system for the last 12 years. He is 
presently acting principal of P.S. 75, an elementary school in 
Manhattan, but he is barre” from permanant appointment because 
he does not have a New York City liconse as an elementary school 
principal. Mexcado is ina punewiak aatéerese eontticd from | 
Chance in that he does not allege that he nas ever taken the 
relevant Board of Examiners’ Supervisory prinnathon. While the 
present motion was pending -- and while the parties were | 
collecting statistical information pursuant to our order <- the 
Board conducted their November, 1970 series of examinations for 
sa nenkeey school principal. Mercado withdrew from this examina- 
tion and gaeucea te take it on the grounds that the “Board of 
Examiners is not the appropriate agency for qualifyinz school 


: : | 13 | 
p’xsonnel" and "the examination is not relevant ..+e" : 


Both Chance and Mercado were selected for their 
present acting principalshipa by their respective community 


iad 
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school boards, in accordance with New York City’s decentralized 


system. Soe generally, Council of Supervisory Associations v. 
Board of Education, 23 N.Y.S.20 458, 197 N.¥.3.2d 347 (1969) ° 


‘ In some instances such local school boards found, after inter- 
: viewing Licensed principals inten as @ligible by the Board, that 
persons not so licensed were more qualified to serve as principals 
than those takeirtoiat and that they eertucned their duties in 
a superior manner. (See Aff. of Peter J. Straus, 9/22/70). 

There are approximately 1,000 ‘ee erineteate of | 
New York public schools of varying levels (@.ce, elementary day, 
junior high school, hich school, etc.), of whom some act as the 
heads of sitet and others function in administrative positions. | 
O£ the 1,000 only 11 (or approximately 1%) ae plack and only 1 | 
is Puerto Rican, Furthermore, of the 750 licensed Principals of 
New York slementary schools only 5 (or less than 1%) are Black, 
and none is Puerto Rican. Of the 180 high school administrative 
assistants, none is Black or Puerto Rican. : 

of the 1,610 licensed hawteeest principals of New York 
city junior high and elementary schools, only 7% are Black and 
only .2% are puerto Rican. When the list for the position of 
Principal, elementary school, was originally promilgated, only 
6 out of the 340 persons (or about 1.8%) ware Black and none 


was Puerto Rican; and when the list for Principal, high school 
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was promulgated, none of the 22 licensed people was Black or 
Puerto Rican. The promulgated list of licensed Aseietant 
principals for junior high schools reveals that only 55 out of 
690 persons (or 8%) were Black and none was Puerto Rican. | 
Plointiffs contend that the written and oral exanination: 


of the Board are the major factor accounting for this extremely 


low percentage of Black and Puerto Rican supervisors in a school | 


system where 55% of the students are Black or Puerto Rican. 


i 
Plaintiffs summarize their basic argument as follows: 


"[T)hese tests place a premium on familiarity 
with organizational pecularities of the New 
York City school system which, while having 
little to do with cducational needs, are largely 
gained through coaching and assistance from 
present, predominai «ly white, sane sree 
personnel, 


eewe & 


"The testing procedures do not indicate 
a candidate's ability to do the job bsing 
tested for. There is no evidence that they 
measura merit or fitness, they have never been 
validated, and thoy are wrollable psychological 
instruments." Amended Complaint q{22, 23. 
Rather than risk the endless delay that would be 
encountered while the parties obtained this essential evidence | 
through pretrial discovery procedures, we directed the pasties, 
in view of the importance of the issue, to use their best efforts 
to agree on a procedure whereby the Board of Examiners and the 


Board of Education would compile the necessary racial statistics. 


~10Q- 


1892 
All parties cooperated fully and at considerable effort in 


working out almost all of the details of the procedure. to be 
followed. Such differences as existed were resolved by court 
; estes The result has been that after months of researca we 
have been presented with the pass-faii statistics for the relevant 
racial and ethnic groupings of candidates for 50 supervisory 
exa.dnations given over the past few a In view of plaintiffs 
claims that the examinations had a “chilling effect" inhibiting 
Lack and Puerto Ricans from becoming candidates, this statistical 
surve, ("the Survey”) also includes figures as to those candidates 
who “Sid Not Appear” to take the written wea, which fenestra 
the examination process, or who ——— nee took -_ written 


15 
test but did not appear for subsequent parts of the ie leintisein. 


| 
All parties and amici have submitted briefs as to the | 
relevance of the statistics thus adduced and the inferences that 
may ba drawn from them. The parties also submitted affidavits 
py statistical experts. A hearing was heads at Which each side's | 


expert testified and was subject to cross-examination; and we 


heard more oral argument on the statistical data. after declining 
the opportunity to examine and pecne-enaniine any other witnesses, | 
including those presented by affidavit, both sides rested on the 

record — adduced.” 


Upon the evidonce thus presented we find that the 
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| 
| 


| 
Analysis of he aggregate pass-fail stz*! 


examinations Which had by far the largest numbex of vandidates, 
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examinations and testing procedures prepared ani admiristered by 


the Board for the purpose of determining which candida 'e es will be 


licensed as supervisory perednnst have ~~ effect of Aiscriminatin 


against Black and Puerto Rican candidates, ! 


The Survey reveals that out of 6,201 candidates taking 


most of the supervisory examinations giver in the last seven a7 | 


years, including all such examinations wittin the izst three (3) | 


. 
years, 5,910 were identified by race, Of the 5,910 thus 
| 


identified, 818 were Black oz Puerto Rican and 5, 092 were “nucasia! 


stics = the entire | 


. 


group reveals that only 31.4% of the 816 Black and Puerto Rican 
candidates passed as compared with 44.3% of the 5,092 white | 
candidates, ?” Thus on an overall basis, white candidates passed 
at almost 1 1/2 times the rate of Black and Teerte Rican 


candidates. These overall figures, cali hak, teli only part of 


the story. Of greater significance are ee resrits of two 


those for Assistant Principal of Day Elementary School and 


Assistant Principal of Junior High School, which bevected the 
following: ; 


eerie © wr 6 erence 
nett ene, “ei ni. “Uhm iteemoyenneepemsenmee 


EXAMINATION CAUCASIAN BLACK PUERTO RICAN PUERTO RICAN OF CEANCE 
RESULT LE 
Total %Pass Total “Pass Total 4Pass Total MPass 
Assistant ; 
principal, 


Day Elementary 
Schools, 1965 
Examination 
(Ppr-03) 
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' BLACK AND PROBABILI 


Assistant 
Principa » 
Junior High 
Schools, 


1968 


Examination 
(PF~45) 


w 


‘ . ‘ 


Table adapted from Affidavit of plaintiffs’ expert, Professor 


Jacob Cohen, May 6, 1971, 95. The computations of probability 
are his; the racial statistics coms directly from the Survey. 


Thus white candidates passed the examination for 


Assistant Principal of Junior High School at almost double the 


_xate of Black and Puerto Rican candidates, and passed the ~ 


examination for Resistant peincival of pay Elementary School at 
a rate one-third greater than Black and Puerto ini candidates. 
The gross disparity in passing rates on these two exnbiitchoes 
is of particular significance not only because they were ne 
by far more candidates than those taking any other examinations 


conducted in at least the last seven years, resulting in 


\icensing of the largest number of supervisors, but also because 
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1171 61.3% 278 45.68% 7 28.57% 285 45.26% l/l milli 


1319 48.82% 236 26.27% 1414.29% 250 25.60% 1/1 — 


| 
| 
| 


' the results would be as follows: ee a ; a 
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the assistant principalship has traditionally been the route to 
and prerequisite for the most important supervisory position, 
Principal. To the extent that Black and Puerto Ricans are | 
screened out by the examination for Assistant Principal they are 
not only prevented from becoming Assistant Principals but are 

kept out of the pool of eligibles for future examinations for the | 
position of Principal as well. ‘The fact that the process involves | 
a series of examinations and that to xeach _ top one must pass 
several examinations at different times in his or her career 


serves to magnify the statistical differences between the white 


‘and non-white pass~fail rates. For instance, if we take a group 
of 100 Black and Puerto Rican candidates, on the one hand, and 
1,000 white candidates, on the other, and assume a eeneine rate 
oe 2b for the dorier ant cf 50% for the latter on a given 
assistant principal's examination (as was approximately the case | 
in the examination for Assistant osinclons of gunior High School), | 


Black & Puerto Rican 25% x 100 = 25) 


Licensed Assistant 
white 50% x 1000 = 500) Prineipa2 


‘The group of 525 licensed assistant principals would 
then form the pool of oligibles for the related principal's 
examination. Assuming the same relative pass rates, we have the 


following results: 
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ie a a 


Black % Puerto Rican 25% x 25 = 6,25) i 
: ) Principals 
White '50% x 500 = 250?) 
Thus the true resulting difference between the Black and Puerto 
“Rican versus the white pass rates would be even more substantial: 
only 6.257% of the Blacks and Puerto Ricans would pass the two 
successive exaninations as against 25% of the whites. 


. 


When wa joo at all 50 examinations which were the 
subject of the Survey, we find that only 34 were taken by at 

least one member of both the white and Black-Puerto Rican racial 
groups, one of these cxamninations (Assistant Administrative 
Director, given Dec. 1957, PF~17) was passed by everyone taking it. 
Auother (Director, Bureau for Children with Retarded Mental ! 
Development, givon gon. 1968, PYr-iS) wae not completed successfully 
by anyens teking sae where remain 32, examinations where one or 
the othe:: of the two main racial groups -~ Black and Puerto 


Rican in one group and white in the other -= had a larger | 


percentage passing than did the other group. Of these 32 


examinations the white group had_a larger percentage passing in 
25 examinations and the non-white group had a larger percentage 


passing in only 7 examinations. Thus the whites passed at a 
proportionately highor rate in three times as many examinations 
ag tho non-whites. The probability of these rosults occurring 


by chance is leos than 1.05 in 1,000. Plaintiffs' Exhibit z to 
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oral hearing of 5/21/71. See also transcript’ of oral hearing 
oi §/21/71 at 14-19. ee 
Plaintiffs offered the testimony of pe. Jacob Cohen, 
“an oxpert in the field of statistics, in support of the validity ig 


and significance of the Survey results. fhe Board, in turn, 


ucduced the testimony of Pr. Nathan Jaspen, an expert in the seme 


i Lc 


Por) 


» An opposltion. ‘h witnesses pessess outstanding 
qualifications. After reviewing theirs testincn:y and appraising 
them as witnesses, we are mcre persuaded by the test ieny of 
Dr. Cohen with respect to certain crucial matters affecting the 
significance of the figuies for present purposes, 

Turning first to the gross aggregate pass-fail 
statistics, Which reveal that the overall pass rate of white 
candidates (44.3,.) was aimost half again as high as the non-white 
rate (21.4%), Dr. Cohen testified that on the basis of such a 

large samplo (5,910 out of 6,201 candidates), the teat results 
were especially valuable and formed a sound basis for drawing 
valid statistical conclusions as to the difference in passing 
rates betweer the ethnic groups involved. In analyzing the. | ie 
statistics he eae the Chi-Square Test (Yates-corrected), hich 
4s a mothod using formulas generally accepted by statistical 
experts to determine whether an observed difforence in any given 


samplo is greater than that which would be expestad on the basis 
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of mere «iance or probability. He found with respect to the 


aggregate test that by "the chi-square (Yates-corrected) 
statistical test, the probability of the difference being a 
" Chance Freayit not related to the factor of race is determined as 


Jess then »no in one billion." (Emphasis added) 


{n an effort to rebut pr. Cohen's analysis the Board, 
after fivet dismissing the aggregate figures as insignificant 
on the ghund that tha “cxaminations are discrete competitions 
related tw widely-varied, particular supervisory examinations*® 
(Second Supp. Mem, 5/7/71, p. 7), offered pr. Jaspen' 8 testineny 
that ha ata not daliaae peobabilitics on the basis of the gross 
aggregate figures becaus: of the possibility of “overlap, * i.e., 
the takiny of more than one test by the same persons. We reject 
this oxciiag for povoral roanona. In the first place, tha Board, 
although it had the data as to any overlap within its control 
and was “Feonded t the opportunity to adduce any relevant evidence, 
chose not to do ao, Under such ciennuntianees we cannot assume 
any Signi¢tcant overlap. Secondly, 42 a "random® overlap existed 
(1-02, ona where the nunizer of persons repeating an examination 
because of 4g shone failure approximates those taking a second, 
MOLE AAVAiweg examins tion after passing the first), it would not 
substontielty affect tho pi obabilities. Dr. Jaspen conceded, 


for Anatatteg, that a randon overlap of as mich as 50% would not 


initia 
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substantially affect tho significance of the- observed aifference 


between tho white and non-white pass rates. Lastly, Dr. Cohen 
(plaintifés' expert) testified that because of the large Chi-Square 
‘value an overlap would not signiticentiy affect the probability 
@ata. In other words, the cheaweet difference between the 
aggregate pass-fail rates of whites and non-whites vee'ten great © 
to be a more matter of chance, unrelated to race! (the chance of 
such an occurrence being less than one in a billion) 50 that wa 
‘1£ the probability were reduced somewhat because of overlap the 
figure would still be significant, @.g-, one in one million, or 
one in 500, 000, and if the overlap were no greater saison 15x, the 
statistical results would not be affected at all. . 7 
Turning to the 50 examinations forming the raw w material 
of the Survey, some were taken by very few people. ‘For instance, 
41 of the 50 examinations were taken by only 83 (or 20. 1%) of 
the total number of Black and Puerto Rican candidates, Because” 
“of the smallness of the sample in each instance the resulting 
figures of each such examination, when meet individually, 
cannot be accorded mich weight or significance for our purposes. 
Although statisticians can analyze very small samples through 
use of a method called the risher Exact Probability Test in 


conjunction with the Chi-Square (Yates-corrocted) Test, in our 


opinion auch a sample is les3 reliable than analyses based on 
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ce ue 
larger samplos, cven after making allowances for greater - 


iarginag of error in use of tho small sample, ‘Use of the small 
sample involves more extrapolation and theory superimposed os 

' less fact. We prefer the seiecen tens content found in the 

larger sample. For the reasons explained by Dr. Cohen -- | 
principally the risk of spurious differences based on insufficient’ 


4 


evidence ~=- we do not believe that meaningful conclusicnas as to | 


differences can be drawn . ‘om the M-ajre@ Gata derived from any 


one of these 41 examinat >-s. 


turning to the © examinations taken by 10 or more 
‘Black and Puerto Rican cundidates, t° w«. £ind that Blacks and 
Puerto Ricans passed at a lower rate chin whites in all of these 
examinations and at a rate traditionaily sentenes by statisticians 
as statistically s nificant in § out of the 9 examinations, If 


we limit our analysis even further nisl those 6 examinations which 


were taken by a minimum of 18 candidates from each of the two 
groups (white, on the one hand, anit Black and Puerto Rican, on 
the other), the results are significant. On all 6 of these 
examinations the percentage of whites passing is higher than the 
percentage of Blacks and Puerto Ricans passing, with the 
differences ranging ican to 26%. 7° 

Finally we arc impressed with the revealing statistics 


comparing the percentago of Black and Puerto Rican Principals to 
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oe es 
white Principals in the five largest school.systems in the 


eae bo 
country: . Q ' 
Total No. of | % Black and 
city Principals . & Black % Puerto Rican Puerto Rican 
Detroit 231 16.7% et 16.7% 
Philadelphia 267 16.7% om oreo 16.7% 
Los Angeles 1,012 8.0% 167% 9.7% 
Chicago 479 6.9% aed : 6.9% 
NEW YORK 862 1.3% is. 1.4% | 
| 


Thus New York City has by far the lowest percentage of minority 
representation. The next lowest city, Chicago, has almost 3 : 
5 times the percentage c“ \/nority principals found in New York 


, City, and as the followin able shows there is a similar imbalance 


of minority Assistant pr ‘pals: | 


| 
{ 
| 


Total No. of % Black and 


City Asst. Principals % Black % Puerto Rican Puerto Ric? 
Detro..t 360 24.7% 0.2% 24.9% | 
Philadelphia 225 37.0% — soe 37.0% 

Los Angeles a mae mone i - 
Chicago 714 32.5% oon 32.5% 
NEW YORK 1,610 70% 0.2% - Te2% 


Plaintiffs also argue that discrimination may be 


inferred from the fact that the percentage of Black and Puerto 


| 


Rican Principals and Assistant principals in New York City schools! 
(1.4% and 1.2%, respectively) is far below the percentage of the 
total student body who are Black and Puerto Rican (55.8%) and 


| 
{ 
! 
| 
| 


when compared with similar figuras for the five largest school 


systoms in the country (New York, Loo Angeles, Chicago, Detroit, 
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and Philadelphia) constitutes not only the lowest minority 
representation in the supervisory ranks, mut also the Lowest 
ratio of such minority group supervise’ ts to minority group’ 


students. We reject this contention. Supervisors are ¢rawn 


eet, Me i 


f-or the pool’ of qualified teachers, mas’, of whom attended 
elementary and high school long ago, and not from present-day 
students. undoubtedly the low number of minority teachers” 
eligible to take the supervisory examinations prescribed - the 
Board has been due in part to the fact that the percentage of 
minority students whe 16 or 15 years ago went on to college and 
qualified for a teaching career, and thus proviged the source of 
z today's minority teachers, was much enallox than the number of 

*} white students following such & course, with the result that a 
lazger pool of qualified white graduates entered the teaching 
profession. tn addition the minor. ee student population in New 
York city has increasad devine the same > period, with the effect 
of increasing the racial imbalance atnien teachers and eetante. 
Current efforts to promote higher educational ‘opportunities 

for minority cite will not produce qualified teachers for some 


years. But ceded chine as to the current dearth of qualified 


minority toachers do act have urphetive valus with manger’ to 
= question before us, which is whether yew york city’ re) examina= 


Ms system discriminates against stnor hey candidates who have 
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already qualified as licers 4 4 teachers. 

For the same reasons we aro pntnevelios with plaintif£o' 
comparisons between (1) tha percentage of Black and Puerto 
Rican members of the general population in New York City, and 
(2) the percentage of Black ang Puerto Rican Principals and 
Assistant principals found in the City's total school supervisory : 
personnel. Statistical cirmsetannt to the general racial 
population of the community may be relevant, in determining whether: 
there is discrimination in job opportunities that are supposed | 
to be open fo the genexal : iblic, ses, Ondee Arrington v, Mass. 
pay Transp. Auth., 506 F. Supp. 1355 (p. Mace. 1969) (bus drivers) ; 


Penn v. Stumpf, 308 P. Supp. 1238 (N. D. calis. ete: {policemen) , 


auatsetee and eligible for appointment, G69, Pporcelli v. Titus, 
302 F. Supp. 726 (D.B.G. 1969), affd., 431 P.28 4254 (34 cir. 


{ 
| 
in tha soloetion of toachors from a pool of those aiveody | 
| 


1970) (per eG or in qualification oF voters or jurors, , 
Smith v. Texas, 311 U.S. 128 (1940); Jones v. Georgia, 389 U.S. 
24 (1967); Coleman v. Alabama, 389 U.S. 22 (1967); Swain v. 
flabama, 380 v.3, 202, 208-09 (1967). But we ~_ ne dealing 
with chtitaeen who must meet preliminary eligibility requirements 
as to education and experience that are not. seaciaeed by most 

of the general population. Where the education of our children 


% 4 


is at stake, such insistence upen the highest possible quality 
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| 
im our teachers is a salutary and Lawful abjective, provided 


it does not result in racial Stectiatnntten between Sonerannes 
‘Who are otherwise eligible, Which is the case here. 

i Notwithstanding the introduction, ad some evidence thus | 
oe irrelevant, the evidence establishes o our satisfaction 
that the examinations prepared and administered by the Board for . 
the licensing of Sinn oot personnel in New York city schools 


do have the de facto effect of discriminating significantly and 


substantially against qualified Black and Puerto Rican applicants! 
However, the existence of ‘such discrimination, standing alone, 
would not necessarily entitle plaintiffs ' relief. The 
Sonstseaniee aang not sauiee that minority group candidates 

vse licensed as supervisors in the same proportion as ‘white 
candidates. Tho goal of the examination procedures should be to 
provide the best qualified supervisors, regardless of their race,| 
and if the exa tions appear_ reasonably constructive to. 

measure knowledge, skills and, abilities essential to a particular 
position, they should not be nuilified because of a de facto | 
“discriminatory impact. We accordingly pasa on to the question of, 
whether the examinats ns under attack can be validated as | 
relovant to the requirements of the positions for which they are 


given, i. ois whether they are “Job-rolated." 
cy | 
The partias Aisagroe « as to Which | side bears the burden | 


e 
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of proving that the examinations are job-related, Plaintiffs 


contend that once a discriminatory impact is shown the burden is 


on the Board to show a compelling necessity or justification for 


tests having an unintended discriminatory effect, citing Griggs v. 
Duke Power EQ0e ao We Se. <0 9+ SUD. Ct. 849 (1971) s Arrington we 
saad: Bay eekiie: Auth., 306 F. Supp. 1355, 1358 (D. Mass. 1969)? 
Gregory v. Litton Systems, 316 F. Supp. 402 (C.D. Cal. 1970); = 
Hicks v. Crown Zellerbach Corp., 319 FP. Supp. 314 (E.D. La. 1970). | 
Most. of these decisions arise under Title vzr of the 1964 civin 
Rights Act, 42 U.S.C. So2000e, et seq., Which embodied an express 
Soaeckeeien Policy directed ——- the consequences af certain 
sontingnent: practices, regardless of the employer's motive or 
interest, and interpreted by the Supxeme Court as placing on the 
_@mployer the burden of showing that any given esting aictanion 
or peeudremant has a manifest function in measuring a candidate's 
capability of performing the employment in question, Sea Griggs . 
" puke Power Company, : eo Cees oe OL Sup. ct. cane a4 (1972) . 
Since we are here concerned, Sones, with whather the Board's 3 
examinations meet the requirements of the Equal eehhebten Clause 
rather than those of a specific Congressional enactment, the | 
foregoing authorities, while relevant. are not COMES ING» | 
The Board contends thet in a constitutional fromewor =k 


plaintiffs mist show that have ” no’ rational sabaeioioyts betwee 
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the cxaminations and the edict eeeeien of thé surervisory 
positions for which they are given, relying on a line of cases 

that include Dandridge v. Williams, 397 U.S. 471, 483 (1970), and | 
" ghaney v. state par of california, 386 F.2d 962, 964 (9th cir. 


1967), cert. denied, 390 ¥.S. 1011 (1968). 


Although. the *rational relationship” ecanmaie ae 
been applied tw practices attacked as causing commercial or 
economic hax &.g., McGowan v. Maryland, 366 U.S. 420, 426 | 
(1961) (statute forbidding sale of certain items - Sunday and 
not ahaa: Lindsley v. Natural carbonic Gas a 220 U.S. 61 
(1911) (revwlating drilling for natural gas): Morey Ve Dowd, 354 
U.S. 457, 463, 464 (1957) temelanins use of premises as 
“currency exchanges"); Williamson v. Lee Optical Cos, 348 U.S. : | 
483, 489 (1954) (regulating the sale of eye glasses); Pt. Smith | 
Light Co. v. Pavin District, 274 US. 387 (1926) (imposing duty 
to soniye on street railways), we are here desiing with racial, 
* not er discrimination, where even reputed_ strict | 
sougtructionists have joined in the view that a more stringent 
standard mat be applied. See Harper v. Virginia Beard of 
Filcetions, 383 U.S. 663 (1966), and dissenting opinion of 
Justice Harlan in Shapiro v. Thom son, 394 U.S. sei 659 — 
Where official conduct discriminates as ¢o race, it is 


“constitutionally susprct," Bolling v. Sharpe, 347 U.S. 497, 
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499 (1954), subject to “most xigid scrutiny, * Koromatsu v. 


‘United states, 323 u.s. 214, 216 (1944), and bears a "very 


heavy burden of justification," Loving v. Virginia, 388 'J.S. 1, 
_9 (195 7), regetdless of lack of intent to discrimir-te racially, 


eee Hobson v. Hansen, 269 PF. Supp. 401, 426, 497 (u....C. 1967), 


affd. sub nom. Smuck v. Hobson, 408 F.2d 175 (D.D.C. 1959), In 


a closely parallel situation arising under Title VIr of “he 


1964 Civil Rights Act, 42 U.S.C. §§2000e, et sea, in Grigg? v. 


Duke Power Co., 401 U.S. 424, 432 (1971), the Supreme court 


pointed out that "good intent or absence ef discriminatory intent 
does not ke employment 1 sToce@ures cr tr “ing mechsnisms that 
operate as ‘built in headwinds’ ~~ minox s+.) gzoups and ara 
unrelated to measuring job excaintey. ak, see also, Baker v. 


Columbr's Municipal Separate School 2 Dasty.ct, . P- Supp. 
(W.D. Miss. Tune 23, 1971); western Additions. Zonmsiaity CRSA 


eer OD 


tion v. Alioto, _.., Fe See. —— (N.D. rapes Jc. 8, 1972). 


We are anciatied ti. whero, is here, plaintiffs eh , 


that tine enninetiane result in substantial diserimination 


agaiast a minority racial group qualified to take em: & strong 
showing muet bé made by the Board that the examinations are 
required to measure abilities essential to performance of the 


‘ supervisory positions for which they are given. Shapiro v. : 


Thompson, 394 U.S. 618, 627 (1969); Arrington v. Mass. Bay ‘Transp. 
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Auth., 306 P. Supp. 1355, 1358 (D. Mass, 1969); penn v. Stumf, 


ee OE 

308 F. Supp. 1238 (N.D. Cai. 1970). 
Neforc considering the ovidance with respect to the 

| validity, reliability and objectivity of the oxaminations 
aonenekad by the Board, a few general prineiples must be stated. 
bt = seems ~ be generally accepted that before an examination 
will be Secognared as a reliable instrument box anngiten the 
fitness and ability of a candidate to perform tasks demanded by 
a given er the exe aination should be verneens. totes 
shown to be ‘reasonably capable of meaaueing mwhat 1% iimeets 


to measure." . 0. G. ‘Stahl, Public Secsoenal. Adninistration, 


Pe 71 (5th ed. 1962). The first step toward this neiss objective 


is to insure that as to subject matter the examination will 
@licit from tho candidate information that is relevant to the 
job for which it is given. If so, it is dencribed as having 
"content valicity.* Otherwise the examination could be a useless 
and misleading “-cl. For instance, an examination eliciting | 
information required to perform a bus~ariver's Job would hardly 
be relevant in datacnining a candidate's capacity to perform the 
duties of a policeman, lawyer or accountant. ' 

in constructing an examination that will have “content 
validity," the prefarred course is first to have an empirical 


analysis made of the position for which it is given, usually by 
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experts or professionals in the field, Such an analysis 
requires ere to ba made of the duties of the job, of the 
performance by those already oceupying it, and of the elements, 
aspects and characteristics that —e for successful performance. 


Questions are then formulated, selective procedures established, 


| 
} 
| 
| 


and criteria prepared for examinors that should elicit. sidccamce 
enabling them to measure these che acteristics, skills and 


proficiency in a candidate and determine his capacity to do the 


- 


job satisfactorily. 
As Professor R. L. Thorndike has observed: 


“Whenever a test is being tried for selection of 
poxsonnel for somo job specialty, it is most 
Gesirabie that it be validated empirically. 
Experimental evidence is called for to show 

that the test is in fact effective in discriminat- 
ing between those who are and those who are not | 
successful in a particular job. ‘Though it may 

2@ necessary under the press of an emergency to 
xely upon the professional judgment of the 
psychologist to establish the value of a test 

for personnel selection, this must be recognized 
as a stop-gap." 7..L. Thorndike, Personnel 
Selection 5-6 (1949). See also, R. Le — & 
E. Hagen, Mcasurement and Evaluation in | 
Psychology and Education 616-41 (1968)? ef. 28 
C.F.R. §1607.5 (Jan. 1, 1971). _ 


To a lesser extont the validity of an examination as 
& means of selecting candidates best. suited for a position may 
also be checked or vorified empirically by comparing the 
rclativo examination scores of auccessful candidates with eis 


‘later pesformance on tho job. Xf thore is a significant 


* cr 
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correlation between test scores and Later performance; the 

examination has "predictive validity." predictive validity is 

of greater significance in evaluating aptitude tests than 

proficiency tests. Purthermore it often takes a long time to 

_ establish such validity and even then the evaluati n depends 
upon the reliability and fairness of the field appraisal of 
performance on the job. : 

‘pavtty, en examination mist, of course, be administered 

objectively, free from bias or prejudice in favor of or against 
particular candidate or group, if te is to be a useful selection 

At tho outset of the hennhneis Betes iene in 

the field of examinations generally, we indicated doubt as to- 

whether examinations could bs constructed that would be valid 

for selection of principals and other supervisory personnel, 

since we viewed their duties as being executive and complex in ’ 

nature, with the euccess of a principal in a given acheol 

Gepending not so much on his knowledge of duties and educational | 
content of courses given by his subordinates as on such intangible 

~ £actors as leadership skill, sensitivity to the feeiings and 

attitudes of teachers, parents and children, and ability to 

articulate, to relate, to organize work, to establish | 


procedures, to promote gocd community relations, to induce 
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subordinates to accept directions, to work -Sooperatively, to 
criticize without creating unnecessary animosity or tii-wil1, 

to analyze and evaluate administrative problems, to take decisive - 

action when required, to operate under stress, to initiate and 

promote new programs, and to instill a feeling oz confidence. 

In short we questioned whether tests that might be valid for 

purposes of determining a candidate’ 8 knowledge of the duties of 

a position or of detailed educational information would be valid 

for purposes of determining his judgment net ability as an 

executive, particularly since the onsen, being a stoiaiiol 

teacher, has sapeady demonstrated his or her cates skills 

in certain fields of education, including ability “ weet, write 

and speak Englich. : 

Notwithstanding our doubt, both sides in this dispute 

wee that while examination procedures may have weaknesses in 

testing for higher level execut: .e positions, seth procedures 

(including use of written tests) are essential tools in 

nolocting suporvisory personnel. However, they differ as to 

the aroas of weakness. Plaintiffs, for instance, state ivy 

®"sontont vaiiaity is of ‘Limited utility dn selecting seceane 

for fairly sophisticated or complex job" because of the 

difficulties faced in preparing tests that fairly samplo the 


job and accurately predict a candidate's performance. See 
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P. Freeman, Theory and practice of Psychological Testing, p. 91 
(3@ ed, 1963); A. Anastasi, Principles of Psychologica Testing, 
pp. 100-04 (34 ed. 1958). According to plaintiffs, examinations 
for such positions are useful only if they have predictive 
validity, since contont validity is primarily selevant for the 
oanes of determining whether a candidate has learned a defined 
body of knowledge rather than for the purpose of determining how 
he will use and appl: “‘:at knowledge on the job. The senek; on 
the other hand, takes tie view that content validity is more 
important in determining a candidate's proficiency or capacity 
to perform the duties of a principal, and that predictive validity 
should be de~omphasized in judging the utility of such tests 
because predictive validity is more relevant to aptitude for 
learning than to achievement or prettateney for satisfactory 
performance on the job. The Board further pointa out thet 
soltewus studies used to dotermine predictive validity are ain 
' generally used in licensing of doctors, eens, or other | 
professionals. - 2 : 

The typi:cl supervisory examination senstuas of two 
parts: (1) a writcen test, and (2) an oral intesview: In 
addition, a problem-based conference test has been used in some 
years for oxaminations for ponitions such as Assistant Sieniiee 


and Director. The percentaga weight attributed to each part of . 
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the examination varies according to the supervisory position 
involved. Usually about 45 to 50% is accorded an the written 
examination and 25 to 30% to the Sint endiabben and another 
25 to 30% to un appraisal of the candidate's training and 
experience, record, written English, and physical and medical 
condition. More recently in an examination given for license as 
Principal of a Day Elementary School the ubheus and oral inter- 
view tests were weighted 50% aach with no _— apparently being | 

given to the other factors mentioned above. 

In the pa.t the wetioen test has usually consisted of | 
an essay portion and a short-answer esotton, the latter pe ee 
of a series of : proximately 200 mitiple choice aii 
each of wiich requires an answer-number to be selected and 
registered by the applicant on 4 veparate anewer a, The oral 

_ interview is conducted by a committee of three examiners. A 
hypothetical problem situation that might. be encountered by a 
Principal or supervisor in the course of administration (e.g., 
problem in human relations, teacher training, or eéuiateteation 


of a program) is put before the candidate, flowed by 


| 
| 
| 


questions to which he or she responds orally at some length. 
The committee then evaluates the applicant’ 8 speech, grammar, 
7 
clarity of expression, comprehension of the problem, definiteness 


_and practicality of his or her proposals, soundness of Judgment, 
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ability to present ideas and meet challenges, poise, courtesy 


and similar qualities. Recently the examination for principal 
has shanged to consist of only an ossay type test, with the 
short-answer portion doloted for the reason that it was largely 
a matter of memory. Howover, the short-answer section has been 
retained in at least some written examinations for Assistant 
Principal, which is an essential stepping-stone to the position 


eet 


of Principal. . 4 
The Board contonds that its examinations are valid, 
reliable and objective, It points to several steps taken in an 


effort to achieve and maintain these goals. It asserts that 


for cach examination it has obtained from the Board of Education 


a statement of the “duties of the position" for which the 
examination is to be given. A committee or panel of srrant- 

’. then assembled to specify those responsibilities Geverdacel 
moat significant, According to the Board, well: known inticsasted 
educators and lay persons are alse consulted with seeneck to 
the qualities for which a candidate is to be tested. With the 
aid of these committees, educators and lay perzons, the Board's 
staff then constructs questions designed to elicit the knowledge 
and skills required of a person holding the supervisory position 
for Which tho oxamination is given. : | 


e « 


According to the Board it achieves objectivity in the 
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scoring of written examin. ..ons by use of code book numbers on 
test papers, Which conceal the ay °icant's identity, by submitting 
answers on any test to more than onv scorer, by use of detailed 
objective rating guidance, and by having answers to essay 
quest ‘ons rated by different committees so that no one individual 
is responsible for rating of an entire examination paper. Oral 
interviews are each administered by panels of three experts, 

In support of its position the Board has submitted 
affidavits of several respected leaders in the tield of 
edu-ational ‘testing ae to the effect that they have reviewed the 
Board's testing procedures and some of the tests prepared by the 
Board and have concluded that the Board has used acceptable 
procedures for designing cxaminations ne content _— 

"In general, the Board of Examiners appears 
to have made a conscientious and ‘nformed 
attempt to devolop test tasks that do 
cormasnond to solacteda ones of the specifica- 
tions sct forth by the supervisory persons. 
who sot out tha requirements for the job." 
(A££. of Dr. Robort L. Thorndike, dated 
October 9, 1970) 
"The approach used by the Board of Examiners 
in determining the validity or relevance of 

ts teuts consists essentially of a strategy 
which realios on the judgmonts of experts ang 
conscncous among them as to what constitutes 
an appsopriata toot item." (ALZ. of Dr. Aaron 
‘Carton, dated October 25, 1970) 

' Ao thus described, the poard's methods and procedures 


soem reasonable enough tc one lacking expertise in the field of 
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educational testing, and normally we would be prepared to accept 
the Board's views on the subject. Indeed, there appear to be | 
few differences between the procedures advocated by the Board | 
and by plaintiffs‘ expert, Dr. Richard s. Barrett. The basic : 
aims of both are the same (to ations welidiés, reliability — 
objectivity), with the parties differing as to the need for and | 
ees of predictive validity in administration of ———e 
examinations. However, a major aroshi ing block -~ ant in our | 
view a fatal weakness in the Board's system <= lies in the methods’ 


: used by the Board 2S ipheosnt the techniques — Eroreciree | 
adopted in principle and appreved by independent experts. As is | 
often the case in such difficult and complex matters, theory is 
ene thing, practice may be another. Despite its professed ains 
the poaxd has not in practice tack subfictent steps to insure . 
that its examinations will be valid as to aes soul ue to 
predictiveness. For examp] _. in support of the Board's content 
validation ee Dr. Murray Rockowitz, a ‘menber of the Board | 
with primary ee for research and development, includes 
tie name of Petor J. Strauss, member of Local School Board No. 2, | 

\as one Ms the “experts” or "well known oan wie lay persons” 
consult toa oy a meeting on December 12, 1969 for advice on 
qualities . tested for in tho oe of an examination 


for Elementary School Principal, en was 2 given ¢ on Hoverher 3, 


ty 


6 
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1970. (Rockowltz Aff. dated oct. 26, 1970). In reply Mr, | 
has submitted his affidavit to the effect that the meeting was 
not called for the purpose of obtaining views on the qualities 
to be touted for or to discuss appropriate selection ceitedia. 
but for other purposes and that these steps were initiated ‘by 
aissatisfied consultants, with nothing being accomplished. 


Mr. Strauss states: 


"It 4s my recollection of the meeting that the 
ensuing discussion of the qualities to be 
sought in a candidate was initiated by the 
consultants, not by Mr. Rockewitz or any other 
reprosontative of tho Doard of Examiners, 
Many of us expressed our dissatisfaction with 
the adequacy and relevanca of the qualities 
Which the Board of Examiners was apparently 
_ intending to test for, based on the established 
‘duties of the position.' we indicated that in 
our view it was essential to test for qualities 
which traditionally have never been considered 
by the Goard of "xaminors in examining principals. 


"5S. The meeting concluded without any 
sort of consensus or agreement having been reached 
between the consultants present at the meeting 
and the members of the Board of Examiners and 
their assistants present. ‘There was never any 
follow-up to the meeting. 


“6. To my knowledge, the ‘duties of the 
position’ previously established were in no way - 
varied or modified as a result of the meeting, 

On August 28, 1969 th> poard of Examiners issued 

on announcement for an examination for the position 
of principal, Day Elomentary School. Said announce- 
ment included a listing of the ‘duties of the : 
yosition.'” (Aff. Peter J. Strauss, dated Nov. 4, 
1970). aa os, 


_« 


It also appears that Harvey B. Scribner, the Chancellor 
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ef the New York City School bigteice, a @istinguished and 
_ fearless educator, does not share the Board's ees in the 
validity of its emninations. ina memoxandum to the Board of 
wonee tse cated October 13, — ‘De. Scribner noted that he 
was. "pressed to evaluate whether the present examination and 
licensing system, which dictates specific limitations of employ- 
ment and promotion of staff for the public schuols, is a help 
wor a hardship {in the efforts of community boards to operate] .... 
He sri ee that in lieu of current employment practices 
the Board wine New York State certification, plus such criteria : 
as each comma tty ‘board might prescribe for those to be selected : 
by it, as the minimum requirenent for employment, in New York 
city public schools. las concluded: 


"For the reasons “outlined in this pesteicn paper, 
‘tay position with regard to the Chance and Mercado 
case is that I prefer not to defend myself against 
the action. To do eo would require that r both 
violate my own professional beliefs and defend a 
system of personnel selection and promotion which 

I no longer believa to be workable. We are facing 

a future in education which leaves no altornativa 

to the selection of the most creative teachers; 

the most talented supervisors; the most able 
principals and other administrators who possess 

the highest level of leadership qualities possible | 
from wherever they may be fdund and as are available 
at any givon time." 


_ Digging deeper, ws find to our G@ismay that the mare's 
! position “an not appear to be supported by most of the research 


reports submitted by it as pie coe inlaid tha content validity of 


oh 
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its supervisory Sek Many of the reports are iseaievent, 
since they concern teachers’, not supervisors’, examinations; or 
they deal with objectivity or consistency; or they are mere 
proposals, not studico. One report merely measures the attitudes 
of the assistant examiners towards the “observed teaching test,” 
Another attempts to correlate the etetiensty of a 300-word 
English test with a 450-word English test, One report relied 
on by the Board Goes deal tangentially with the ‘predictive 
validity of the examinations. xt is based ona pilot atuty, 
admittedly very meager - scope. mhe test results showed that 
tuere was little or no correlation pavens success on the tests 
and job success (in some cases the contest. ‘group any better, in 
others the experimental op did batter, = some cases there. 
was no statistical =: there .was no attenpt in this 
pilot study to determine whether those who scored lower on the 
examination (but passed) did less welt as Principals. “ Nedther 

: was there an attempt to determine whether those who failed the 
examination but who are Acting principals are rated as succezsful 
or unsuccessful on the job. In only two out of the six years 
tested (1946 7 1966) did the differences reach statistically 
significant levels in favor of the Board's position, and in cheese 


two years the xeport candidly admitted: “... the relatively 


small population of the samples involved should be noted." 
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Pinally, the entire study reveals only the mean rank order of the 3 
examination scores. 
Reluctant as we are to invade a profession chaxacteriaeé 


"py an expertise not shared by us, we must conclude on the record 


before us that while the Board has adopted procedures designed 


: 
| 


for content validity, it does not appear in practice to have 
achieved this goal. Our conclusion, which is based upon our 
appraisal of affidavits of experts furnished by the parties, is 
confirmed by our own study of some of the examinations themselves. 
Turning first to the short-answer, multiple-choice tests, many 
of the questions strike us as having Little relevance to the 
qualities expected of a school supervisor. Some examples are 
—e in the margin.” . : a 
: A review of ~~ balance of a typical short-answer 
test and, indeed, of the essay int test eee that the 
| eseeuittones appear to as aimed at testing the candidate's ability 
to memorize rather than the ee normally susutiakel wit: 
a school administrator. This impression is confixmed by a 
well known publication widely used by candidates to prepare for 
supervisory ontebentions, which is entitled “PRINCIPAL, ASSISTANT-. 
TO-PRINCIPAL” by Paul Treatman, ee principal, New York City 
Public Schools (Teacher License Series, ARCO). With respect to 


tho short-answer test it advocates a course of training in 


e 
, ne 
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memorization, or mnemonics, including study. of Regents’ review 


books, multiple choice parts of previous examinations and the 


rn rene 


like. interesting and instructive as would be the reading of 
' the underlying works, the omests is on superficial mnemonics. 
he tad to memorize and regurgitate anne lists of bad 
answers ie not, we hope, a true test of a candidate's qualifica- | 
tions for a supervisory position. l 
The inadequacy of such testing procedures led the | 
Board finally to drop the short-answer test for Principal snes! 
as Dr. Isidore Bogen, a werd member stated, “The Board of | 
Examiners felt i was largely a matter of memory." Notwithstand- 
ing this frank admission, the short-ancswer examination has been 
setaines in tests for Assistant Principal, apparently on the 
theory that an Assistant yrincipal should know the content of 
the curriculum taught by teachers under his supervision. “While 
we might be prepared te accept this compromise ue it were the 
sole objectionable feature, the same weakness te Sens ‘in many 
of the essay =e tests, which one would expect to be used 
for the purpose of eliciting some of. the qualities required of 


a Principal (e.9., accurate gramnar, clarity of expression, 


organization and presentation of ideas, and creating thinking) 
as woll as ‘the candidate’ 2 reaction to problems and his judgment 


and ability in analyzing and solving then. Many essay queations, 
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however, appear to be aimed solely at the ability to memorize 


"duties." Indeed “*¢ Treatman manual, supra, gives the following 


advice to candidates preparing for essay questions: 


“one step in this direction is the mastery 
of mnemonic devices, such as those found in 
the previous chapter, that help organize your 
knowledge of curriculum. Another and related 
valuable approach is the mastery and use of a 
set of memonic devices which will help organize 
your knowledgo and cxperience in administrative 
and supervisory aspects of school life. Such a 
set of mnemonics appears below. In answering 
any essay question which seems to lend itself 
to menemonic application, the candidate will have 
to use his own good judgment in deciding which 
elements of which dovices are most appropriate 
for use. Blind exploitation of every element in 
a mnemonic device might result in a fatal waste 
of time. 


eereeae 


“A caroful study of thase sample answers 
will roveal to tho cand’.date the technique of 
writine concise, credit-laden statements that 
outlined model answers cannot reveal. The 
author is convineed that tho outlined model 
answor teaches little or nothing to the e 
candidate, whe must ctill see, and learn to 
write in, a terse style, employing many 
concrate illustrations, and following, 
whorever possible, a recognizable organization...” 
("Principal, Assistant-To-Principal” by Paul 
—— supra at 212-13) 


Samples of some mnemonic methods and professional jargon \ 


24 
suggested by the author are given in a footnote. 


furning to ‘the oral interview and conference ks, 


we axe handicapped in our ability to appraise their validity 
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by the absence of any tangible, objective data, since the 
principal qualities that should be evaluated by the examining 
committee in the oral interview (e.g., leadership, speech, poise, 
‘ comprehension, soundness of judgment and ability to present ideas 
and meet challenges) are intangible, and the judgment. of the 
interviewing committee can only be as sound as ‘the capacity GR 
its members to recognize the presence or absence of these 
qualities in each candidate. in the absence of any record of 
such interviews or of any proof that the ceninens are 
incompetent ‘or that the interview problems or questions have 
been AEPCAOVARS: we <a no finding as to the content validity 
of the orel examinations, standing alone. 

With respect to the question of the objectivity of the 
okneientions: adequate precautions appear to have been taken by 
the Board to assure objectivity in the conduct of the written 
examinations. As for the oral interviews, we are not persuaded 

by vague and speculative hearsay statements that members of the 

examining committees intentionally Giseriminate against Black 
‘Or Puerto Rican candidates because of their color, use of 
“southernisms," ox the idke. (See AfZ. of raythe J. Gaines). 
Since each candidate has already been licensed as a teacher and 


has received New Lork State certification for a supervisory 


position, the examinors aro dealing with a group & well educated 
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apzi‘«" nts. On the other hand, the hard, col@ facts are that 
als » "i-ers of the Board of Examiners are white, the great 
majorit, of the oral examiners or examination assistants are 

' white, and white candidates have passed the combined oral and 
written tests at a much higher rate than Black and Puerto Rican 


candidates, ~esulting in de facto discrimination against the 


© 


—9 
latter. This raises a “serious and substantial question” as © 


to whether discrimination against Black and Puerto Ricans is 
not being unconsciously practiced by white interview examiners. 
See Checker| Motors Corp. v. Chrysler Corp., 405 F.24 319, 323 
(2d Cir. 1969) » 
CONCLUS? >" 
The evidence reveals that the examinations prepared 
and administereé by the Board of Examiners for the Licensing of 


supe-visory personnel, such as oeinaiente and Aesistant 


principals, have the de facto effect of discriminating significant, 


and substantially against Black and Puerto Rican applicants. 
Despite the fact that candidates for such positions 
are licensed teachers who have satisfied prerequisites as to 
education and’ experience established by the Board of Education 
for supervisory positions and have pre been certified by 
the State of New York for tho positions sought, a survey of the 


results of examinations taken by 5,910 applicants (of whom 
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€18 were Black or Puerto Rican) reveals that white candidates 


have received passing grades at almost 1 1/2 times the rate of 
Black and puerto Rican candidates and that on one important 
emudiavion given in 1968 for the position of Assistant Principal, 
Junior High School, white candidates passed at almost double the 
rate of Black and Puerto Rican candidates, (see PP. 12-13, supra) 
The Giscsintanteny: effect in the latter case is aggravated by 

the fact that the Assistant principalship has traditionally been 
an essential prerequisite to the more important SE" 
position of-Principal. (See pp. 13-14, supra). = 


= existence of such Ge facto racial Aiscrimination 


is further anes by the fact that only 1.4% of the = 
principals, and 7.2% of the Assistant Principals in New york 
city schools are Black or Puerto — percentages which are 
far below those for the same pomictenn: in oe four other largest 
city school systems in the united states, (See pp. 19-20, supra) 
For example, the percentage of Black and puerto Rican Principals 
in each of the cities of Detroit and Philadelphia ‘is 16.7%, or 
12 times as high as that in New York. 

Such a discriminatory impact is constitutionally 
nuspect and places the burden on the Board to show that the 
examinations can be justified as necessary to obtain Principals, 


Assistant Principals and supervisors possessing the skills and 
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qualifications required for successful performance of the autios 


of these positions. ‘the poard has failed to meet this burden. 
Although it has taken some steps towards securing content and | 
predictive validity for the examinations and has been improv ing 
the examinations during the last two years, the Board has not 

in practice achieved the goals of constructing examination 
procedures that are truly job-related. Many objectionable 
features remain, with the result that some 37 minority Acting 
Principals and 131 minority Acting Assistant Principals, who are 
considered fully qualified and are Geaired for permanent appoint~ 
ment by the coe school boards, are rendered ineligible 
for such permanent appointment. A study of the written 
examinations reveals that major portions of them call simply 


for regurgitation of memorized material. Purthermore, the oral 


exumination procedure leaves open the question of whether white 
candidates are not boing favored =~ albeit unconsciously =< by 
committees of examination assistants who have been entirely or 
predominantly white. 

There appears to be a strong likelihood that plaintiffs 
wit} pravnil cn tha morits at trial. It further neenne that 
Plaintiffs would suffer oreater harm from denial of preliminary 
injunctive xolief than defendants would suffer from the granting 


2s 5 


of relief. Denial of rolic£ would perpetuate existing racial 


when 
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discrimination, depriving plaintiffs and others similarly 


situated of an equal opportunity for permanent appointment and 
licensing as supervisors. During the long period bafore the 
case would finally be aljudicated on the merits, permanent 
appointments would >2 made from lists promulgated by the Board, 
which would have the effect of threatening the continued 
employment of these holding acting appointments, since New York 
law requires vacancies to ba filled from the eligibility lists 

12 such lists exist. N.y. Dduc. Law §2573(2); Board of Education 
By-“,aws §101(3). 

Granting of preliminary relief, it is true, will 
temporarily prevent the appointment from eligible liste of those 
Who have, after the arduous process of taking the existing type 
of examinations, successfully passed and been placed on the : 

@ligible list. However, thoy will not be denied an equal ” 
Opportunity in the future to qualify under such examination 
procedures as aro found to ba constitutionally permissible and, 


pending trial of the case, trey would bea eligible for appointment 


as Acting Principals or Acting Assistant principale. ‘Thus the 
balance of hardships tip: decidedly in favor of plaintiffs, 
and, pending final deter: ‘nation of the merits, the effect of 


preliminary relic? would be to preserve the status quo until 


the issues ara resolved. Chee:er Motors Corp. v. Chrysler Corp., 


' 
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405 F.2d 319, 323 (2d cir. 1959). 


Having in mind that the existing examination system 


is not believed by the Chancellor of the New York City District 
to be a workable one, we do not envisage any great harm to the 
public as a result of preliminary relief. On the contrary, such 
relief may possibly lead the Roard of Examiners, after taking 
another hard look at its examination procedures, to consider an 
overhaul that will not only eliminate racial discrimination, 

but lead to procedures that will be more adaptable to the 
Community School Board type of administration. 

Lastly we cannot overlook the fact that various persons 
having the duty of selecting supervisory personnel, such as 
members of community school boards, have stated in affidavits 
£iled with the court that they have often found that holders of 
Licenses from the noard of Examiners do not possess the ability 
| to perform the duties of a supervisory position for which a 
candidate is sought, with tho result that in order to select 
qualified personnel it has been necessary to appoint unlicensed 


* 


candidates on an acting basis, (See Affa, of Dr. Edwin J. Haas, 
Edythe J. orvines, and Peter J. Strauss). 

For tho foregoing reasons a preliminary injunction 
will issue restraining defendants from (1) conducting furthe- 


examinations of the type found to be unconstitutionally 


nL, 


/ 
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discriminatory against placks and Puerto Ricans, and from 


(2) promulgating eligible lists on the basis of such axamination 


procedures. 


The foregoing shall constitute our findings of fact 


and conclusions of law as required by Rule 52(a), P.R.C.P. 


Wo take this opportunity to express »ppreciation to 


the parties for their thorough papers, and to the amici for their | 


briefs, Which were of assistance in resolving the difficult and 


| 
complex issues. 


‘Settle order on notice, 


—t i a 


eemmenemeend 


U.S.C. J. 
Dateds July 14, 1972. 


Ss 


Sce tolanthe, Act I: 


“Titles st. -. ennoble, then, | 

All the vommon Councilmens 
Peers shall teem in Christendom, 

And a Duk ‘s exalted station 
Be attained by Competitive Examination." 


42 U.S.C. §1981: 


"6.1981. Eoual rights under the law 

"ALL persons within the jurisdiction of - 
the United States shall have the same right 
in every State and Tervitory to make and 
enforce contracts. to sue, be parties, give 
eviderce, and t> the full end equal benefit 
of all laws and sroceedings for the security 
of persons and property as is enjoyed by. 
white citizens, and shall be subi ect to like 
punishment, pains, penalties, taxes, licenses, 
and exactions of every kind, and to no other," 


42 U.S.C. §1983 g 


"§ 1983. Civil action for deprivation of sights 
“Every person who, under color of any 

statute, ordinance, regulation, custom, or 

ucaga, of any state or Torritory, subjects, or 


eanses to ha subjccted, eny citizen of the 
United Statos or other person within the 
jurisdiction thorcof te tho deprivation of 
any rights, privileges, or immnities secured 
by “he Constitution and laws, shall be liable 
to tho party injured in an action at law, suit 
an equity, ox other proper proceeding for 
redress," 


New York Constitution Art. 5, §6:% 


"&.6. [civil service appointments and 


ee ee 


norotions; voterans' preference and’ 


poolmumonts and promotions in the eivil 
servico of tho ctata and all of tho eivil 


Se 


6. 
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divisions thereof, including cities and 
villages, shall be mda according to 
merit and fitness to ba ascertained, as 
far ao practicable, by examination which, 


as far as practicabla, shall be compat:itives se." 


New York Educa*ion Law § 2590-3 (3) (a) (1): 


‘¢ 2590-1. Arvointment and removal of 
iret Aa tee eee tite teen 
persons in tho teaching and 


; 
BUpSxVAisoryv service 
eee “omen. tatiana 


vwwee 


"3. (a)(1) The board of examiners 
shall prepare and administer objective | 
examinations to astermine the merit and 


fitness of ali candidatas for teachin and 
g 


, BUpervesory servicn positions, other than 


tho positions of 


nancollor. exeenutive 
deputy eity sup-: 


ntondent, degaty edty | 
Superintondent, assistant city superin- 
tendent end community superintendent, 
Bxaminations for teaching positions may 
consist in part of the National Teachers ° 
Examination cdministered 2» che Educational 


Tosting Service of Drincecon, New Jersey," 


6 2569. 


Of one mill: 


members, ono of wor 


whom . ba the super=_ 
intendent O£ schools 


city school 


Qistrict of the cit: : New York or a 
Geputy superintendent theres 


Q£ designated 
by him to act in tis atead dur 
No person other 
Superintendent 
Superintendent co 
ain tho supervic: 

the clty, serve on 


che chancellor, the 
ox a deputy 
shall, while 
nexrvice of 
It shall be 


ving hls pleasure, 


7. 
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the duty of the board to hold examinations 
whenever necessary, to examine all applicants 
Who are required’ to be licensed or to have 
their names placed upon eligible lists for 
appointment in the schools in such city, 
except examiners, and to prepare all : 
necessary cligible lists, subject to the’ 
responsibilitics among tho members of the 
board of examinors heroinafter set forth. 
The board shall periodically review the 

validity and reliability of examinations 


as woll as examination procedures." (Emphasis - 
added) 


New York Education Law §2573(10) : 


"10. Ina city having a oe 
of one million or more, recommendations for 
appointment to the teaching service shall be 
from the first three persons on appropriate 


_cligibie lists prepared by the board of 


examiners. Eligible lists, including 
competitive and qualifying lists, shall. 
not be merged and a list shall be exhausted 
or have oxpired before nominations are made 
from a list of subsequant date. No 
competitive or qualifying eligible list 
except existing principals' eligible list 
shali remain in force for a longer period 
than four years, rov have a life of less than 
three years, no eligible list now in force 
shall terminate any sooner than four years 
from the date on which it was promulgated. 
eee The board of education, on the «come 
mendation of the superintendent cf sen ols 
shall agesignatc, subject to the other pro- 
visions of this chapter, the kind and grades 
of licenses Which shall be required for service 
‘a6 principal, bxanch principal, director, 
assistant examiner in the board of examiners, 
supervisor or teacher of a special branch, 
head of department, assistant, school 
psychiatrist, school psychologist, school 
medical inspector, echool aurist, school 
psychiatric social worker, school social 

caso worker, xrescarch assistant, teacher-clerk, 
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school clerk, school secretary, clerical 
assistant, industrial or trade helper in 
vocational cchools, school librarian, 
laboratory assistant, placement and 
investigation assistant, financial assist- 
ant, machine shop assistant, tool boy, or 
any other position of the teaching staff 
together with the academic and professional 
qualifications required for each kind or 
gxade of license. No person required to 
have a license under the provisions of this 
chapter in order to ba employed in a 
position who coos not have such license 
shall have any claim for salary, except 
that a person who has bsen assigned to 
teach in a subject or field not specifically 
covered in his license but on the same rank 
ox level of sorvice shall be entitled to 
his salary." 


Plaintiffs hava also moved for a determination that 
this action is a clans action maintainable under 

Rule 23, F.R.Civ.P. Although plaintiffs brought this 
motion on soon aftor their original motion for a 
preliminary injunction, in accerdance with Lecal civil 
Rule LIA, all partics nave acrecd that our decision on 
this class action motion would be reserved. Defendant 
Board of Examiners has not yet filed any papers opposing 
plaintiffs’ motion making this action a class action. 
Defendants have 10 days from the date of this decision 
to £ile opposing papers. Otherwise the motion will be 
granted. 


NYARBSSA has a membership of approximately 300 New york 
City public school administrators and supervisors. 

Its purposes is "the attainment of an effective education 
for black children in the New York City School Systen.", 
ASPIRA is a nonprofit corporation “devoted to the 
improvement of tho Pucrto Rican communities of the united 
States through cducation and loadership development.” 
"SSPIRA" is the Spanish word for "“espiring." 


’ 


Tho PEA is a nonprofit corroration, chartered in 1899, 
in order “to sccuro and maintain the highest possible 
standards of public education in the city of New York." 


~ty~ 
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N.Y. Educ. Lb. §§2569, 2590-4(1).- (4) (B)» (4) (a). 


Telegram of Luis Mercado to Board of Examiners, Nov. 3, 
1970, Exhibit B to defendant Board of Examiners’: First 
Supplemental Mcmorandum of Law, received Nov. 6, 1970. 


14. See Court Orders of December 29, 1970, February 16, 
1971, April 13, 1971, and April 29, 1971. 


15. Plaintiffs contended, inter alia, that the discriminatory 
effects of the examinations were and are well known to 
the Blacks and Puorto Ricans. Hence there wus a “chilling 
effect" on their taking the exzminations. Though we | 
ordered these statistics on "withdrawal® and “not . 
appearing” to be taken for the sake of completeness, | 
.we place no reliance on this argument. Merely because | 
someone thinks an examination is discriminatory is not 
proof that the exantostson is in fact discriminatory. 


16. We have based our conclusion on the statistical evidence, } 
not on “straightforward moral and constitutional | 
arithmetic." Hobson v. Hansen, F. Suppe __ 
(Civ. Action #52-66, May 25, 1971), slip opinion at 23. 
We are not hero dealing with simple arithmetic, cf. 
Reynolds v. Sims, 377 U.S. 533 (1964) (“one man, one 
vote"), but with something approaching “constitutional 
calculus.” 


17. Of the candidates identified as Puerto Rican. only, 
27.59% passed; of the candidates identified as Black, 
31.56% passed. 


18. The one Black who took it failed; no Puerto Ricans 
took £%; and 5 whites took it. Four failed and the 
last. one withdrew, which in effect meant that he failed 
because he could not successfully complete the examination 
="rocess,. 


19. See Affidavit of Dr. Jacob Cchen, dated May 13, 1971, 
q3, n.2, for a list of these nine examinations. 


me LY wo 
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These axaminations are; 


Assistant to principal, Day Elementary School, 

4/65, PF-03 
Superintendent of Home Economics, 6/67, PF=-12 
Superintendent, Early Childhood, 2/68, PF=20 
Supervisor of Art, 3/68, PF=23 
Supervisor of Music, 5/68, PF-28 
Assistant Principal, Junior High School, 9/68, PF-43. 


The sources of these statistics, which have not been 
disputed by defendants, are set forth in detail in 
Plaintiffs’ Memorandam filed Sept. 24, 1970, pp. 3-4, 
n.2, aS supplemented by letter of Elizabeth B. DuBois 
to the Court, dated June 11, 1971. ' 

\ 
Profonsor Robert L. Thorndike, Teachers College, Columbia 
university: Dr. Marvin Sontag, Associate Professor of 
Psychology and Education, Teachers College, Columbia ‘ 
University; Agsociate pr “cessor Avron Suss Carton, State 
university of New york; Dx. Esiu Kaya Carton, Professor 
of Educational Psychology, Hofstra University. 


1961 Examination for Principal, Day Elementary School 


"64. Of the following characters in the 
nursery rhyme, THE BURIAL OF POOR © 
COCK ROBIN, the one whd killed Cock 
Robin is the 


he 
2. 
3. 
4. 


1965 Examination for Assistant Principal, Junior igh School 


"211. I'vo Got a Little List, from the Mikado 
. io cung by 


1. Nanki-poo 2. Pish-Tush 3. Ko-Ko 4. Pooh-zat 


"212. Arthur Sullivan of the team of Gilbert and 
Sullivan, wrote . 
1. Gypsy Love Song 2. The Lost Chord 
3, An, Swoct Mystery . 4. A Kiss in the Dark 
o£ Life : 


o 2 8 © @ 


-vi- 


24, 


"218. 
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Which ona of the following violin 
makers 15 NOT of the great 

triumvirate of Cremona? 

l. Amati 2. Stradivarius 3. Cnet 
4. Maggini" 


1968 Examination for pee principal, Junior High School 


"63. 


"74. 


'*75. 


“OBJECTIVES OF ELCMENTARY EDUCATION 


Charactor 

Cur American Heritage 
Health 

Exploration 

Tainiing 

Mnowlesgos and skille 
Avpzeciation and Expression 
Social Relationships 
Economic Rolationships 


The author of Dodsworth is also the author of: 
1. Daisy Miller 
2. Elmer Gantry 
3. Henry Esmond 
4. Mrs. Dalloway 


eevee wf 


The author of Tender is the Night also wrote: 
1. The Great Gatsby 

2. Butterfield & 

3. The Sun Also Rises 


4. Sanctuary 


A contemporary play in which one of the 
characters seems to turn into a eneneree 
was written bye : 

1 ° Beckett 

2. Pintor 

3, ZToncsco 

4. Shaw" 


ee EE 


eeeek & 
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“DEVELOPING A LEARNING EXPERIENCE 
Rica 


Readiness 

Instructional materials provided 
Carrying out experience 
Evaluating the experience 


"KINDS OF LEARNING EXPERIENCES 


U.S.0.4 : 


unit 
Short-term 
Ongoing (centers of interest) .: 


“AREAS FOR EVALUATION 


I_Am Same 


Interaction among children 

- Atmesphere of classroom 
Materials 
Status (health, social, interests) 
Achievement i: 
Mothods and procedures 

. Exporioncos, worth of 


"USES OP EVALUATION 


psesalsss 


Prograss and grade placement 
Reports to parents 

Analyois of pupil difficulties 
Guidance 

Grouping 


@eoaoe 


. 


“IMPROVING SCHCOL DISCIPLINE 


port Cages 


Planning of pstondards and rules 
Environment, improvement of 


ovili- 
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Routines, training in 
Teaching, improvement of 
Conferences 

Analysis of difficulties 
Guidance procedures 
Evaluation and follow-up’ 
Self-control emphasis" 


Tho Poara has not adduced ctatistics as to the race of 

the excminers or examination assistants who have conducted 
the oral examinations other than to observe, at a recent 
lerge-scale oxamination, that of approximately 200 persons 
serving as examination assistants over 30, or 15%, were 
Black or ‘Ppucrto Rican. 


Furthormore, the racial statistical survey is not broken 
Gown according to grides received by candidates on the 
components of examinations (i.0., scores on written, 
essay, short-answer, oral, appraisal of record, etc.). 


Interim Injunction (Mansfield, C. J.) filed on 
July 23, 1971 
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UNITED STATES DISTRICT COURT 
SOUTHERN DISTRICT OF NEW YORK 


BOSTON M. CHANCE, LOUIS C. MERCADO, : 


et al., 
Plaintiffs, CIVIL ACTION 
-against- 70 Civ. 4141 
THE BOARD OF EXAMINERS AND THE PEMPORARY 
BOARD OF EDUCATION OF THE CITY : RESPRAENEING 
OF NEW YORK, et al., ORDER 
: : Kirt 
Defendants. aie ; ’ , 
: [/Myonc Ton 


-— == = ee = ee ee ee er er ell ele lle lel CX 


This cause came on to be heard on plaintiffs' 
motion for a preliminary injunction, and the Court, after 
due deliberation, rendered an opinion filed on July 14, 
1971, which opinion constituted its findings of fact and 
conclusions of law. It appearing to the Court that pend- 
ing settlement of a preliminary injunction, temporary 
relief is appropriate, it is 

ORDERED that, pending the settlement of a pre- 
liminary injunction, defendants, their agents, servants, 
employees, attorneys, and all persons in active concert 
and participation with them be and they hereby are: 

(1) restrained from announcing or conducting 

further examinations for supervisory service 

positions in the New York City School System; 

(2) restrained from promulgating or otherwise 

publishing any new eligible lists for super- 


visory service positions in the New York City 


School System; 
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(3) restrained from using or permitting to be 
used outstanding eligible lists for supervisory 
service positions in the New York City School 
System in making appointments or assignments to 
vacant supervisory service positions, provided 
however, that this order shall not affect the 
validity of any other requirements for appoint- 
ment or assignment to Supervisory service posi- 
tions established pursuant to law; and it is 
further 

ORDERED that the parties are directed to attempt 


to agree upon a proposed preliminary injunction order to 


Se pr- 
be submitted to the Court on or before Muguet ©, 1971, and 


failing such agreement the parties may submit their 
respective proposed orders to the ‘Cou: on the aforesaid 
date; and it is further 

| ORDERED that defendants’ time to submit opposing 
papers on plaintiff's motion to declare the action a class 


sepT re 
action is extended to Aupest » 1971. 


Dated: New York, New York 


July23 , 1971 
Sf Wane R. marstelel 
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UNITED STATES DISTRICT COURT 
SOUTHERN DISTRICT OF NEW YORK 


BOSTON M. CHANCE and LOUIS C. 
MERCADO, et al., 


Plaintiffs, 
: CIVIL ACTION 


» 20 Civ. 4141 


~arainst- 


BOARD OF EXAMINERS, et al., 


) _—-2 
Defendants. —AFEIDAVET 2s 
> oe cS ott 
da eed an ae ake ae ae ee a a xX ‘ =) 
rT — 
STATE OF NEW YORK ) 2 < 
>: SS3-- od 7 

COUNTY OF , YORK ) oe 


MARVIN WEINGART, being duly sworn, deposes sha 
says: 

1. I am an elementary school principal as- 
signed by the Board of Education as a Unit Head of the 
Board of Examiners of the Board of Education of the City 
of New York, one of the defendants herein, and submit 
this affidavit in support of defendant Board of Examiners' 
proposed preliminary injunction. 

2. As Unit Head, I am responsible for the 
preparation and the administration of the examinations 
for most elementary school licenses. I have been 
functioning as a Unit Head since September, 1968. Prior 
to that time, beginning in September, 1962, I served as 
principal of P.S. 158, Brooklyn, and P.S. 345, Brooklyn. 
From September, 1959, to June, 1962, I served as an 
assistant principal at P.S. 129 in Manhattan, spending 


one year of that time on assignment to the Board of 
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Examiners. From September, 1955, to June, 1959, I was 
a teacher of English, Flushing High School. From 
September, 1953, to June, 1955, I was a teacher of 
English at Junior High School 73, Brooklyn. From 1950 
to 1252, I was a teacher of Common Branches at P.S. 6, 
Meriiiattan. 

3. I hold a B.S. in English Education, 
New York University (1950), and an M.A. in Elementary 
Educaticn, New York University (1951). 

4. In carrying out my responsibilities as 
Unit Head, I perscnally supervise the preparation of 
all questions contained in every examination under my 
jurisdiction. I do this in consultation with experts 
in various fields, making certain that the questions 
on the examination are related to the duties prescribed 
for the job by the Chancellor. I performed this functior. 
in connection with the development of the elementary 
school principal examination which commenced with a 
written examination administered on November 3, 1970 
(hereinafter "the 1970 elementary school principal 
examination"). 

5. In its proposed preliminary injunction 
the Board oft Examiners requests the Court to permit 
the promulgation and use of the eligibility list for 


the position of Principal, Day Elementary, Sshool, dased 


siitessSg Knnsseaness ean RRR RAS sh ana T e rontemen an eta cnen a ni mte a nti ecto cxssssciaissatainiorinmano.... 
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The Board of Examiners 


on the 1970 examination therefor. 


contends that the examination itself and its administratio 
substantially meet the constitutional criteria enunciated 
by the Court in its opinion. The Board asserts that the 
promulgation of the aforesaid eligibility list wil. 
fulfill the objective articulated by the Court, namely, 
staffing the schools of New York City with qualified 
personnel who have been selected by a valid examination. 
This affidavit is intended to set forth facts in support 
of the above contentions. 

6. Each and every question on the 1970 elemen-~ 
tary school principal examination 1s related to the job 
of elementary. school principal. 

A. Both the written test and the interview 
test selections consist of questions concerning practical 
problems facing an urban school administrator today. 
(Written test attached as Exhibit 1.) 

B. The short answer questions clearly test 
the applicant's knowledge in the field of education, 
dealing with such matters as eurrieulum fesign, pupil 
evaluation, testing procedures, program evaluation, 
supervisory functions, instructional materials, human 
relations and community relations. 

C. The two essay questions deal with real- 
life situations regularly confronting the principal of 
an urban elementary school. The first essay question 


describes an inner-city school riddled with the kind of 
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problems to which there are no glib answers. Certainly, 
textbook regurgitation could not possibly supply the 
answers to the problems posed. The situation is designed 
to elicit a thoughtful analysis from the candidate which 
can test his ability to deal with the realistic problems 
of the job. 

The second essay question consists of ten 
realistic and practical situations requiring decisions 
that every school principal must make. The candidate is 
asked to analyze the situation, indicating the additional 
4nformation, if any, that he should obtain and the factors 
he should consider in reaching a decision or arriving at 
a course of action, and the actions he should take with 
respect to each situation. These problems are job related 
in the most meaningful sense of that term. 


D. The interview test selections also 


call for a practical approach to school problems, with 


an emphasis on inter-personal relations. Additionally, 
the test seeks to determine the applicant's abilities 
in oral discussion. He 4s rated on such qualities as 
speech, comprehension of problems, definiteness and 
practicality of proposals, clarity of explanations, 
resourcefulness and ability to establish rapport with 
other people. Different interview test selections are 
used or iifferent examination days. (Copies of all 
interv.:. test selections are attached hereto as Exhibit 
2). 

7. Numerous changes have occurred since the 
1964 clementary school principal examination which have 


increased the participation of blacks and Puerto Ricans 


~ 
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in the 1970 examination and have enhanced their prospects 
for success in this examination. 

A. The Board of Education's liberaliza- 
tion of eligibility requirements for this examination 
has enabled a large number of blacks and Puerto Ricans 
to become eligible. In the 1964 examination, an applicant 
had to have at least 5 years of teaching experience, 
plus 3 years of supervisory experience, in addition to 
educational requirements, in order to be eligible to 
take the examination. In 1970, an applicant had to have 
4 years of teaching experience and 1 year of supervisory 
experience. However, an applicant could substitute a 
college supervised internship for the supervisory ex- 
perience requirement. Thus, an applicant in his fourth 
year of teaching could qualify for the examination. 

The effect of these changes is illustrated by the 
following figures: 


# Appli- Black or Puerto Rican % 
cants Applicants Identified 
From Statistical Survey 


Ordered by the Court 
1964 Elem. Prin. 449 6 1.38 


1970 Elem. Prin. 2369 279 (Undoubtedly 
more who are 
not identified) 12% 
B. There have been significant changes 
in the nature of the testing and in the weighting of the 
various parts of the examination. Some of these changes 


have implications with respect to the performance of 


minority group applicants. For example, the 1964 


reduced from 2 to 1. Moreover, the average number of 
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examination gave numerical consideration to training and 
experience. Since very few minority group applicants 
have been in the system long enough to have extensive 
experience, it was believed by the Board of Examiners 
that this consideration may have worked to their detri- 
ment. Accordingly, tre Board eliminated numerical 
consideration of training and experience from the 
weighted average for this examination. Furthermore, 
tho interview test was given greater weight in the 1970 
examination. In 1964, the interview test was weighted 
20, with the written test weighted 4O. In 1970, the 
4nterview test was weighted 50, with the written test 
Wetanted 50. This change was made partly in response 
to the contention that minority groups do less well on 
written examinations than on oral presentaticn, and | : 
also reflected the views of members of a Committee : 
of professionals and 4nterested laymen who were con- 
sulted with regard to various testing procedures. 
C. Since the 1964 examination, significant 
changes in rating procedures and criteria have been 
nade. The standards for written English were liberalized. 
Demerits assessed for diction errors were reduced from 


2 to 1, and demerits for spelling errors were likewise 


pormicnible domorito per page was changed from 4.0 
to 5.0. 


| 
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The criteria used for rating an applicant's 
performance in his present position were arrived at in 
consultation with Community School Boards, Community 
Action Groups and currently practicing administrators 
who identified the most significant elements in evaluating 
performance on the job. This extensive survey, prior 
to the recommendation of the criteria to be used, was 
made possible by funds provided by the United States 
Office of Education. . 

D. Many more black and Puerto Rican 
examination assistants were involved in formulating 
and rating the tests in 1970 than were utilized in 1964. 
Black and Puerto Ricans acted as assistant examiners 
in every stage of this examination. Of the 9 examina- 
tion assistants at the first consultation meeting, 2 
were black. Of the 10 who submitted essay questions, 
2 were black; of the 4 who prepared the rating guides 
for the essays, 1 was black. 

Moreover, every effort was made to recruit 
minority group college professors and principals to 
conduct the interview tests. Since New York City had 
so few black and Puerto Rican principals who were not 
involved a. applicants, the Moard of Examiners re- 
cruited 13 black pr yols from Philadelphia, Washington 
Mount Vernon, N.Y., and Montclair, N.J., to assist. All 


in all, out of approximately 200 assistants used in 
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conducting interviews, about 35 were black or Puerto 
Rican. 

E. As part of the Board's effort to 
improve examination procecures over those used in the 
1964 examination, the Board consulted with many groups 
and individuals. The primary motivation for these con- 
sultations was to insure the selection of appropriate 
individuals for the job by the use of examinations which 
were intensely job related. For example, I personally 
visited the following institutions in an effort to 
develop examinations as job related as possible: 

1. New York City Personnel Division | 
to discuss use of the Experience Interview, the rating : 
sheets utilized and other interview techniques used. 

2. American Telephone & Telegraph 
Company Management Assessment Center to observe and 
confer regarding techniques used to identify personnel 
with management potential. 

i Lehman College, — discuss possible 
use of videotapes to simulate lessons, conferences, 
school personnel in action, etc. Our hope was that 
through videotapes we might actually bring the class- 
room and the school situation to the test room. 

4, Hunter College, to preview films 
that might be used as the basis of an interview or 
supervision test. 

5. P.S. 78 Bronx, to evaluate the 


use of a videotape machine in the classroom, to see 
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whether this technique could be adapted for testing 
purposes. 
Some of the Suggestions arising out of these 
visits have been incorporated in planned examinations. 
In addition to these visits, I conducted 
& meeting on December 12, 1969, at which the members 


‘of the Board of Examiners met with Community Board Members| 


college professors of education (including well-known 
and highly-regarded blacks) and induotry personnel 
officials. This is the meeting referred to above which 
resulted in a greater emphasis being given to the 
interview test, Other meetings were held in an effort 
to improve the quality and Job relatedness of this 
esmtantion. For example, a meeting was held with 
Mr. David Seeley and other representatives of the: Public 
Education Association, and another meeting was held 
with the head of the Elementary Division of the Board of 
Education and other administrators, including 2 black 
principals, in order to obtain their views with regard 
to testing procedures. 

8. The 1970 examination reflects the most 
intense effort on the part of the Board of Examiners 
to conduct an examination which is thoroughly job 


related. In my Opinion, we. succeeded in. this effort. 
ae f fe 


SWORN to before me this Marvin Weingap 


3lst day of August, 1971. 


 -. A 


Notary Public 


Affidavit in Opposition to Motion of Thomas McGee 
verified on September 8, 1971 and submitted on 
September 9, 1971 
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JUNITED STATES DISTRICT COURT 
ooo DISTUICT OF NEW YORK 


rere Oe eee ee oe ee 


| BOSTON M. CHANCE and LOUIS c, 
MERCADO, et al., 


Fisintitts, CIVIL ACTION 
~against- 7G Civ. G47 


| 
THE BOARD OF EXAMINERS AND THE 


|BOARD OF EDUCATION OF THE CITY : AFFIDAVIT 
|OF NEW YORK, et al., 


Defendants, 


| 


STATE OF NEW YORK ) 


: 88.: 
COUNTY OF KINGS ) 


THOMAS McGE&, being duly Sworn, depises Sd 


— Rh 
d+ I am the Administrator of the Board 6f Examiners. 


2. This affidavit is Submitted in support of defen- 


dant Board of Examiners! propo 
} 


Sed preliminary injunction, 
3. Although the Boaru of Examiners maintains no 
records on the racial or ethnic background of examination 


candidates, I have prepared an analysis of the pass-fail 


results on the 1970 elementary school principal examination 


utilizing the identification information contained in the 


Court-ordered Survey for prior examinations. This analysis 


yielded the following data: 


1970 Elementar ‘ipal Examination 


Candidates Candidates 
didates Identified Identified 
Identified as Black or as White or 
from Court Puerto Rican Other from 
Ordered from Court- Court-Ordered 


Survey Ordered Survey Survey 
1,094 224 
55 
279 


Percentage 80. 


I also analyzed the pass-fail results fur the 


1970 elementary school principal examination to determine 


ihow persons listed as acting elementary school principal 


|| by the Department 


f Personnel of the Board of Education 


examination. 


| performed 


j 


Of 46 such persons, 39 


the examination of which 37 passed and 2 failed. 


7. sa. 


|Sworn to before me this 


day of September, 1971. 


Commics’onm of Newsy, Cin a re Wey 
Kine County Ciera - Rs, 2054 
cevsicring Contegg Juty 1, 1978 


Memorandum regarding Preliminary Injunction 
(Mansfield, C. J.) filed on September 20, 1971 
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* * 


UNITED STATES DISTRICT COURT 


SOUTIERN DISTRICT OF NEW YORK 
sostos M. CHANCE and LOUIS C. ad 
TRCADO, individually and on 


pohait of all othors similarly 
situated, 


Plaintiffs, .” 90 Give 4241 


-against- i Memorandum Regarding 


preliminary Injunction - 
THE BOARD OF EXAMINERS and THE 


BOARD OF EXEUCATION OF TH: CITY 
OF NEW _— ot _ 


Defondants. ; 


“samen nrnnnnnnnnnn = HX 
MANSFIELD, Circuit Judges : 

Plaintiffs and the Board of Examiners (“the one 
have submitted forms of a proposed proliminary injunction 
which diffor in certain significant, respcects,. — with 
supporting memoranda, affidavits and oth.r papers. After 
roviowing these documents wo have today signed and te an 
ordor incorporating plaintiffs’ proposals with some 
‘modifications. — 

Tho major’ differences betwaoon the partios hens 
to (1) tho Board's promulgation of lists based upon examinations 
givo.. by it since this action was commenced, including that 


concluded on Novembor 3, 1970, for tho position of Principal, 
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o> sitll school, anda (2) tho poard's conduct of future 


Gxaminations and its promulgation of lists based thereon pending 
final gotermination of tho action. As for tho first of these 
catogories tha board asks pormission to promulgate lists based 
upon its rocont examinations. Its request for permission to 
promulgate lists based on the Novombor 3, 1970, examination is 
. supported by (1) tho ateidavit of Marvin ae dated August 
31, 1971, to tho effect that that oxamination has met the 
standards for job-rolatedns9 roferzed to in. our —— and 
(2) by the affidavit ef games McGee dated septenbet 8, 1971, 
stating that an unis ‘of scores of approximately 60% of the 
candidates taking that oxamination vavenis that €0.% vr, the 
Black and Puerto Rican candidates passed which was higher | Shan 
tho percontage for Black and eens Rican candidates tor 
earlier oxaminations and close. to ‘the rate “ waite candidates 
(88. saad Plaintifés object to the Weingart affidavit on the 
ground that it socks to reopen and relitigate issues which were 
oeret in earlier hearings and wich were the subject of 
findings in our decision dated July 14, 1971, rendered acter 
@cfendants declined the opportunity to _ additional 
evidence, following which the zecord. was closed for purposes 
of dociding the application for prelininazy injunctive hints 


Plaintiffs also queption somo of the statements made by 


~2- 
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Mx, Woingart, whom they have no% had tho opportunity to exoss~ 


‘axamine, and correctly point out that tho Novenboor 3, 1970. 
oxamination, togethox with ovidence portaining to it, was pofore 
_ us and was dobated pefora: wo xendored our decision. 

as for the McGee affidavit, plaintiffs attack the 
now statistics offered by it, principally on the ground of 
—4nconplotoncss, sinco it fails to gunich tho paes-fail ratios 
fer almost 407% of tne candidates who tool: the Rovesoer 1970 
" examination. From the figures presensed by it with respect. to 
- 60-odd percent of the candidates. the balance, of almost 40% 
must have had = low sccres, which yould indicate that the 
two groups (i.0-- tno 60% ana the 40%) aitfer radically and that 
= figures prosentsd by the Board cannot be used as a basis 
for extrapolation for ali candidatcs. Furthermore, the Poard 
has not disclosed the mout-of £" peers nace by it, which decides 
tho poxcentaga of ae candidates and hence the comparison 
Hence such percentage: for éifferent racial groups. As one 
would expect, plaintiffs want discuvery for. the purpose of 
écotermining alt of the facts, including relevant statistics. 
tho proceduroas used by the Board, and the extent to which they 
wore affected by tho pen: Litigation. 

Although the atiiéavits presented by the Board with 


rospect to the Novemb"* 3. 1970, examination indicate ¢hat the 


=j- 


SE eae 
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soaxd haga boen making offorts to construct oxaminations that 
will bo sguetuaucans and that their efforts havo bcon accompanied 
by a sharp reduction | in the disceximinatory impact caused by its 
examinations, wo Go not believe that this ovidance waxrants our 
changing tho £indingo made on tho basis of the more extonsive 
evidence introduced at our earlicr hearings, where plaintiffs 

had tho right of « cx eee which they do not havo with 
espoct to Woingart and McGao affidavits. | 
-In tho meant ime our injunction will restrain seh 
ee further ‘examinations or pzomilgation of further eligibility © 
tists by the Board, subject to its right upon reasonable notice 
to plaintiffs to apply for modification of our. order to permit . 
furthor oxaminations. presumably such an application would be 
mado after thorough analysis and Gisclosure to plaintiffs of - 
ell pertinent facts. This docs not mean that we.propose to act 
as a super-Eoard with respoct to such examinations, since on 
lack the exportise, time and facilities required to participate 
in dotail in tho construction of examinations or in a meaningful 
analysis of test results. If this case is to be brought promptly 
to final adjudication, tha parties must cooperate fully in 
making available ta er other all eo, facts (including, 


for examplo, the entire sampl: of candidates who took the 


Yovembor 3, 1970,’cxamination, the scoring of both oral and 
. ry N 
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writton portions, and ‘tho cut-off score used by the Board) . 
and in devising appropriate eritoria. While plaintiffs appear 
as adversaries in this preceeding, we urge them, iu undertaking 
—— important aes wes the task as flexibly and 
objectively as possiblo, with a wi iLlingnesy’ to yield to tha 
public interest at stako rather than to inoist on specific 
criteria that may be impractical or unroalistic, whether in the 
field of predictivo validity or a 

In tho meantime we fail to see that oar eect nine 
injunction will harm tho nubhe ox the administration of New 
York City einen: since supervisory vacancies cutee filled by 
acting suporvisory personnel appointed pursuant to a system 
established by the Board of apenueiaaiens and permanent spootetees 
would not have gained tenure. (Chs. 116 and 117 and 1102 Now 
York — 1971) Xndocd, we note that a. resolution along those 
iinos has eiecody been prasented to the Board of BAncation for 
its considoration, which scems to be a constructive step toward 


an dintorim solution of the difficult problems that must be solved.: 


cD cet 


Ratads Soptomboy Rip B07 ke 5 
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Preliminary Injunction (Mansfield, C. J.) filed on 
September 20, 1971 


t 
* 
* 
i! 


A Pease 


Serre: 


eet ie ed 


——— 
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> nnnecasa e 
UNITED — DISTRICT COURT ast RIC 7 
SOUTHERN DISTRICT OF NEW YORK «be O ‘pp’ 
: ee SEP 20 1971 


u S. bd. of Ne ex 
BOSTON M. CHANCE and LOUIS C. MERCADO,  soeee 

individually and on behalf of all j[ 
others similarly situated, 


EG wales 06 ew. ews ow 
Plaintiffs, 
~against- 


THE BOARD OF EXAMINERS AND THE BOARD 
OF EDUCATION OF THE CITY OF NEW YORK: 3 
GERTRUDE E. UNSER, individually and 


in her capacity as Chairman of the 3 

Board of Examiners; JAY E. GREENE, 

MURRAY ROCKOWITZ and PAUL DENN, 8 ' 

individually and in their capacities 70 Civ. 4141 

as members of the Board of Examiners; : ' 

MURRY BERGTRAUM, individually and PRELIMINARY 
~ in his capacity as President of the s INJUNCTION 

Board of Education: ISAIAH E, 

ROBINSON, JR., individually and in 3 

his capacity as Vice-President of 

the Board of Education; MARY E, a 

MCDADE, SEYMOUR P. LACHMAN, and 

JOSEPH MONSERRAT, individually and g. 

in their capacities as members of 

the Board of Education; HARVEY B. 8 

SCRIBNER, individually and in his oa 

Capacity as Chancellor:of the City 3° 


School District of the City of New 
York; and THEODORE H. LANG, indivi- 2: 


‘dually and in his capacity as Deputy 


Superintendent of Schools of the Slee 
City of New York, . 
3 


Defendants. 
‘ 3 


ee ee ee a a a ae ae eae eee 


» 
ad 


Plaintiffs having moved for a preliminary 
injunction, and the court having considered the complaint, 
as amended, the affidavits, exhibits and briefs submitted 
‘in anppere of said motion and in opposition | thereto, and 


all othor papers herntoforo filed, together with certain 


| 
, 
| 
| 


Pee ee vn ee oe Se an are ee nen 
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statistical evidenco compiled pursuant to court order, ana 
having heard oral arguments and received evidence in open 
court, and having made its findings of fact and conclusions 
er in its opinion filed July 14, 1971, it is 

ORDERED, that defendants, their agents, servants, 

employees and attorneys and all persons in active concert 
and participation with them be and they hereby are, 
pending cas Senaentnartan: of this ‘action: 

(1) restrained from conducting dartnes 
examinations for supervisory peatkiins in the 
New York City School System and from processing, 
grading or in any way continuing to administer. 
any part of any supervisory examination procedure 
in the New york city — System; 

(2) restrained i. promulgating eligible 
lists or issuing licenses on the basis of 
examinations for supervisory positions in the 
New York City School System which have been, or 
are sat ik the process of being, administered; 

(3) restrained from making, authorizing or 
allowing regular or permanent appointments or 
assignments on the basis ta any lists previously 
promuldated pursuant to examinations for supervisory 
en sate a in the New York City School System: 

(4) ‘ordered to make all vacant supervisory 
‘positions in the New York City School system 
available on an acting basis to candidates who 


satisfy the educational and experience qualifications 
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established by state law and by the Chancellor 


and the board of Education of the City of New 


York, including such cligibility requirenents 

as the latter may hereafter establish on an 

interim basis for selection and appointment of 

acting supervisory personnel, without regard to 

whether such persons eeesuialy hold supervisory 

‘tinted or regular appointments or assignments; 
and it is , 

FURTHER ORDERED, that any party may, upon at 
least one (1) week's written notice to counsel for all 
other parties, apply for modification of this ete to 
permit further examinatidéns for supervisory positions, and 
the promulgation of lists, issuance of licenses, and making 
of appointments based thereon, provided all essential 


relevant data with respect thereto have first been made 


to such other parties to review such data and to confer 
with the applicant with a view to resolving any differences 
that may arise and reaching agreement upon new examination 


procedures that aro to be the uubject of such application. 


Dated:. September/ 7, 1971. 


fa: 
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U.S.C.of 


available to all other parties and an opport':.iscy afforded 


